[ 538.089895] env[65382]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 538.089895] env[65382]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 539.092298] env[65471]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 539.092298] env[65471]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 540.665638] env[65471]: INFO neutron.common.config [-] Logging enabled! [ 540.666035] env[65471]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 27.0.1.dev79 [ 540.666314] env[65471]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=65471) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 540.666655] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 540.666752] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 540.667610] env[65471]: WARNING oslo_policy.policy [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 540.667825] env[65471]: WARNING oslo_policy.policy [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 540.669559] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] VMware NSXv3 Agent initialized successfully. [ 540.669916] env[65471]: DEBUG oslo_concurrency.lockutils [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] Acquiring lock "singleton_lock" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 540.670087] env[65471]: DEBUG oslo_concurrency.lockutils [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] Acquired lock "singleton_lock" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 540.670299] env[65471]: DEBUG oslo_concurrency.lockutils [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] Releasing lock "singleton_lock" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 540.670590] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] Full set of CONF: {{(pid=65471) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:275}} [ 540.670698] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] ******************************************************************************** {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 540.670795] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] Configuration options gathered from: {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 540.671161] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 540.671329] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 540.671432] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] ================================================================================ {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 540.671594] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] agent_down_time = 75 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.671730] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] allow_automatic_dhcp_failover = True {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.671862] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] allow_bulk = True {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.672013] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] api_extensions_path = {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.672155] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] api_paste_config = api-paste.ini {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.672290] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] auth_strategy = keystone {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.672391] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] backdoor_port = None {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.672489] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] backdoor_socket = None {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.672620] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] backlog = 4096 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.672752] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] base_mac = fa:16:3e:00:00:00 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.672906] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] bind_host = 0.0.0.0 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.673054] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] bind_port = 9696 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.673188] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] client_socket_timeout = 900 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.673324] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] config_dir = [] {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.673430] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.673564] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] config_source = [] {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.673702] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] control_exchange = neutron {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.673841] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] core_plugin = ml2 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.673973] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] debug = True {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.674121] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] default_availability_zones = [] {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.674329] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.674465] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] dhcp_agent_notification = True {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.674595] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] dhcp_agents_per_network = 1 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.674724] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] dhcp_lease_duration = 86400 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.674864] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] dhcp_load_type = networks {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.675007] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] dns_domain = openstacklocal {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.675148] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.675276] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] enable_default_route_bfd = False {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.675402] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] enable_default_route_ecmp = False {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.675528] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] enable_dvr = True {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.675653] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] enable_new_agents = True {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.675780] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.675924] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] enable_signals = True {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.676077] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] enable_traditional_dhcp = True {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.676212] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] external_dns_driver = None {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.676339] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] filter_validation = True {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.676477] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] global_physnet_mtu = 8950 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.676609] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] graceful_shutdown_timeout = 60 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.677093] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] host = cpu-1 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.677093] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] host_dvr_for_dhcp = True {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.677093] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] http_retries = 3 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.677189] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] instance_format = [instance: %(uuid)s] {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.677311] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.677537] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] ipam_driver = internal {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.677715] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] ipv6_pd_enabled = False {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.677916] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] l3_ha = False {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.678117] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.678270] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] l3_ha_network_physical_name = {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.678411] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] l3_ha_network_type = {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.678606] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] log_color = False {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.678677] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] log_config_append = None {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.678816] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.678947] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] log_dir = None {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.679092] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] log_file = None {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.679198] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] log_options = True {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.679335] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] log_rotate_interval = 1 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.679477] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] log_rotate_interval_type = days {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.679609] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] log_rotation_type = none {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.679710] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.679808] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.679945] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.680166] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.680329] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.680521] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] max_dns_nameservers = 5 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.680579] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] max_header_line = 16384 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.680691] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] max_l3_agents_per_router = 3 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.680815] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] max_logfile_count = 30 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.680940] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] max_logfile_size_mb = 200 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.681082] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] max_subnet_host_routes = 20 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.681252] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] my_ip = 10.180.1.21 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.681357] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] my_ipv6 = ::1 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.681485] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] network_auto_schedule = True {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.681608] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] network_link_prefix = None {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.681741] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.681875] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] notify_nova_on_port_data_changes = True {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.682019] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] notify_nova_on_port_status_changes = True {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.682162] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] pagination_max_limit = -1 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.682291] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] publish_errors = False {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.682420] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] rate_limit_burst = 0 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.682558] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] rate_limit_except_level = CRITICAL {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.682685] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] rate_limit_interval = 0 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.682813] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] retry_until_window = 30 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.682941] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] router_distributed = False {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.683079] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] rpc_resources_processing_step = 20 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.683257] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] rpc_response_max_timeout = 600 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.683446] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] rpc_response_timeout = 60 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.683587] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] send_events_interval = 2 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.683739] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] service_plugins = ['router'] {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.683882] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] setproctitle = on {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.684015] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] shell_completion = None {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.684164] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] state_path = /opt/stack/data/neutron {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.684301] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] syslog_log_facility = LOG_USER {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.684431] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] tcp_keepidle = 600 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.684568] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] transport_url = **** {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.684697] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] use_journal = False {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.684822] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] use_json = False {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.684946] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] use_ssl = False {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.685082] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] use_stderr = False {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.685221] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] use_syslog = False {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.685347] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] vlan_qinq = None {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.685469] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] vlan_transparent = None {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.685597] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] watch_log_file = False {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.685807] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] wsgi_default_pool_size = 100 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.685984] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] wsgi_keep_alive = True {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.686150] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.686283] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] wsgi_server_debug = False {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.686431] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] oslo_concurrency.disable_process_locking = False {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.686575] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.686716] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.686848] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.686985] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.687140] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.687274] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.687421] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] profiler.connection_string = messaging:// {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.687563] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] profiler.enabled = False {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.687701] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] profiler.es_doc_type = notification {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.687834] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] profiler.es_scroll_size = 10000 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.687999] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] profiler.es_scroll_time = 2m {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.688146] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] profiler.filter_error_trace = False {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.688314] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] profiler.hmac_keys = **** {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.688456] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] profiler.sentinel_service_name = mymaster {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.688599] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] profiler.socket_timeout = 0.1 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.688733] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] profiler.trace_requests = False {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.688868] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] profiler.trace_sqlalchemy = False {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.689043] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] profiler_jaeger.process_tags = {} {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.689192] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] profiler_jaeger.service_name_prefix = None {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.689327] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] profiler_otlp.service_name_prefix = None {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.689475] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] oslo_policy.enforce_new_defaults = True {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.689745] env[65471]: WARNING oslo_config.cfg [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 540.689892] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] oslo_policy.enforce_scope = True {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.690045] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] oslo_policy.policy_default_rule = default {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.690197] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.690335] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.690476] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.690666] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.690751] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.690855] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.690988] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.691143] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] oslo_policy.remote_timeout = 60.0 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.691286] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.691428] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] agent.extensions = [] {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.691565] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.691701] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] service_providers.service_provider = [] {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.691840] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] QUOTAS.default_quota = -1 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.691982] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.692166] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] QUOTAS.quota_floatingip = 50 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.692312] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] QUOTAS.quota_network = 100 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.692442] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] QUOTAS.quota_port = 500 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.692571] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.692699] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] QUOTAS.quota_router = 10 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.692823] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] QUOTAS.quota_security_group = 10 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.692950] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.693090] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] QUOTAS.quota_subnet = 100 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.693227] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] QUOTAS.track_quota_usage = True {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.693369] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.693497] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] privsep.group = None {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.693622] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] privsep.helper_command = None {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.693750] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] privsep.log_daemon_traceback = False {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.693883] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.694023] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] privsep.thread_pool_size = 8 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.694149] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] privsep.user = None {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.694289] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.694416] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] privsep_dhcp_release.group = None {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.694540] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] privsep_dhcp_release.helper_command = None {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.694666] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] privsep_dhcp_release.log_daemon_traceback = False {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.694801] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.694929] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.695071] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] privsep_dhcp_release.user = None {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.695215] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.695343] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] privsep_ovs_vsctl.group = None {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.695471] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] privsep_ovs_vsctl.helper_command = None {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.695597] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.695732] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.695864] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.696026] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] privsep_ovs_vsctl.user = None {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.696169] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] privsep_namespace.capabilities = [21] {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.696299] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] privsep_namespace.group = None {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.696426] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] privsep_namespace.helper_command = None {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.696555] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] privsep_namespace.log_daemon_traceback = False {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.696688] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.696818] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] privsep_namespace.thread_pool_size = 8 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.696952] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] privsep_namespace.user = None {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.697100] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] privsep_conntrack.capabilities = [12] {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.697231] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] privsep_conntrack.group = None {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.697358] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] privsep_conntrack.helper_command = None {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.697489] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] privsep_conntrack.log_daemon_traceback = False {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.697625] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.697757] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.697883] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] privsep_conntrack.user = None {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.698061] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] privsep_link.capabilities = [12, 21] {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.698205] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] privsep_link.group = None {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.698370] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] privsep_link.helper_command = None {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.698521] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] privsep_link.log_daemon_traceback = False {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.698603] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.698806] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] privsep_link.thread_pool_size = 8 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.698856] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] privsep_link.user = None {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.699008] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.699185] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.699327] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] AGENT.continue_on_failed_promotions = False {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.699459] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] AGENT.dscp = None {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.699592] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] AGENT.dscp_inherit = False {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.699733] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] AGENT.force_mp_to_policy = True {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.699862] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] AGENT.locking_coordinator_url = None {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.699992] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] AGENT.log_agent_heartbeats = False {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.700140] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] AGENT.logging_expire = 1 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.700277] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.700408] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.700545] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] AGENT.polling_interval = 240 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.700734] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.700870] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.700948] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] AGENT.report_interval = 30.0 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.701098] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.701239] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.701381] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.701511] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] AGENT.sync_skew = 60 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.701640] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] AGENT.synchronization_queue_size = 20 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.701770] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] AGENT.use_helper_for_ns_read = True {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.701907] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] SECURITYGROUP.enable_ipset = True {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.702055] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] SECURITYGROUP.enable_security_group = True {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.702203] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.702343] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.702481] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] experimental.ipv6_pd_enabled = False {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.702638] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] ml2.extension_drivers = ['port_security'] {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.702775] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] ml2.external_network_type = None {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.702922] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.703075] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] ml2.overlay_ip_version = 4 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.703219] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] ml2.path_mtu = 8950 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.703358] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] ml2.physical_network_mtus = {} {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.703500] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] ml2.tenant_network_types = ['vlan'] {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.703639] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.703779] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] ml2.type_drivers = ['vlan'] {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.703917] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] AGENT_CLI.neutron_port_id = [] {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.704058] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.704230] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.704385] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.704528] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.704666] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.704802] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.704939] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.705092] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.705298] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.705447] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] NSXV3.nsxv3_login_password = **** {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.705588] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] NSXV3.nsxv3_login_port = 443 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.705723] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] NSXV3.nsxv3_login_user = admin {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.705858] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.705992] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.706142] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.706271] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.706408] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.706594] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.706682] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.706820] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.706950] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.707105] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.707249] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.707384] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.707517] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.707702] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.707845] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] vsphere.vsphere_login_password = VMware1! {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.707983] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.708152] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.708293] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] nova.auth_section = None {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.708435] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] nova.auth_type = password {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.708574] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.708703] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] nova.certfile = None {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.708836] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] nova.collect_timing = False {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.708980] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] nova.endpoint_type = public {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.709146] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] nova.insecure = False {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.709275] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] nova.keyfile = None {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.709415] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] nova.region_name = RegionOne {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.709545] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] nova.split_loggers = False {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.709673] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] nova.timeout = None {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.709808] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] placement.auth_section = None {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.709948] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] placement.auth_type = password {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.710096] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.710227] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] placement.certfile = None {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.710359] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] placement.collect_timing = False {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.710492] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] placement.endpoint_type = public {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.710617] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] placement.insecure = False {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.710743] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] placement.keyfile = None {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.710876] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] placement.region_name = None {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.711020] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] placement.split_loggers = False {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.711127] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] placement.timeout = None {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.711263] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] ironic.auth_section = None {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.711394] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] ironic.auth_type = None {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.711521] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] ironic.cafile = None {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.711650] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] ironic.certfile = None {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.712156] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] ironic.collect_timing = False {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.712156] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] ironic.connect_retries = None {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.712156] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] ironic.connect_retry_delay = None {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.712156] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] ironic.enable_notifications = False {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.712288] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] ironic.endpoint_override = None {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.712391] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] ironic.insecure = False {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.712515] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] ironic.interface = None {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.712638] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] ironic.keyfile = None {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.712765] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] ironic.max_version = None {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.712890] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] ironic.min_version = None {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.713032] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] ironic.region_name = None {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.713168] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] ironic.retriable_status_codes = None {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.713291] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] ironic.service_name = None {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.713416] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] ironic.service_type = None {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.713543] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] ironic.split_loggers = False {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.713666] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] ironic.status_code_retries = None {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.713790] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] ironic.status_code_retry_delay = None {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.713914] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] ironic.timeout = None {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.714057] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] ironic.valid_interfaces = None {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.714185] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] ironic.version = None {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.714319] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] cli_script.dry_run = False {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.714460] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.714593] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.714722] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.714849] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.714980] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.715124] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.715252] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.715381] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.715508] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.715643] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.715769] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.715932] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.716109] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.716253] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.716386] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.716528] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.716659] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.716790] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.716928] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.717077] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.717210] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.717339] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.717464] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.717591] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.717716] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.717844] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.717968] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.718135] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.718268] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.718396] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.718525] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] oslo_messaging_rabbit.ssl = False {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.718661] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.718797] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.718926] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.719094] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.719240] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] oslo_messaging_rabbit.ssl_version = {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.719370] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.719509] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] oslo_messaging_notifications.driver = [] {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.719643] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] oslo_messaging_notifications.retry = -1 {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.719792] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.719924] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] oslo_messaging_notifications.transport_url = **** {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.720038] env[65471]: DEBUG oslo_service.backend._eventlet.service [None req-8df527a9-2123-4517-8469-ad2d2d4ab8c8 None None] ******************************************************************************** {{(pid=65471) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 540.721177] env[65471]: DEBUG neutron.agent.securitygroups_rpc [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] Init firewall settings (driver=nsxv3) {{(pid=65471) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 540.722507] env[65471]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=65471) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 540.722743] env[65471]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] RPC agent_id: nsxm-l-01a.corp.local [ 540.724941] env[65471]: DEBUG dogpile.cache.region [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 540.725071] env[65471]: DEBUG dogpile.lock [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 540.725205] env[65471]: DEBUG dogpile.lock [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 540.725251] env[65471]: DEBUG dogpile.lock [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 540.725341] env[65471]: DEBUG dogpile.cache.region [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 540.725423] env[65471]: DEBUG dogpile.lock [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 540.725626] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 540.746585] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] Session token - acquiring [ 540.748132] env[65471]: DEBUG networking_nsxv3.common.locking [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 540.748307] env[65471]: DEBUG oslo_concurrency.lockutils [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 540.748447] env[65471]: DEBUG oslo_concurrency.lockutils [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 540.748819] env[65471]: DEBUG oslo_concurrency.lockutils [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 540.761091] env[65471]: DEBUG oslo_concurrency.lockutils [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 541.053825] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 541.079421] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 541.079623] env[65471]: DEBUG dogpile.cache.region [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] Cache value generated in 0.354 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 541.079681] env[65471]: DEBUG dogpile.lock [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 541.079802] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] Activating Policy API Provider. [ 541.079996] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] Looking for the default Infrastructure Rules. [ 541.157736] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] Looking for the Default Layer3 Logged Drop Section. [ 541.174243] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 541.174727] env[65471]: DEBUG networking_nsxv3.common.locking [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 541.174898] env[65471]: DEBUG oslo_concurrency.lockutils [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] Acquiring lock "all" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 541.175017] env[65471]: DEBUG oslo_concurrency.lockutils [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] Acquired lock "all" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 541.175518] env[65471]: DEBUG oslo_concurrency.lockutils [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] Acquired external semaphore "all" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 541.175853] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 541.690816] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 542.193517] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 542.696158] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] Inventory metadata is going to be refreshed. [ 542.696506] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 543.660380] env[65471]: DEBUG networking_nsxv3.common.locking [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.660657] env[65471]: DEBUG oslo_concurrency.lockutils [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 543.660657] env[65471]: DEBUG oslo_concurrency.lockutils [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 543.660968] env[65471]: DEBUG oslo_concurrency.lockutils [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 543.672717] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 543.673568] env[65471]: DEBUG oslo_concurrency.lockutils [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 543.674170] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 543.691070] env[65471]: DEBUG networking_nsxv3.common.locking [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.691273] env[65471]: DEBUG oslo_concurrency.lockutils [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 543.691331] env[65471]: DEBUG oslo_concurrency.lockutils [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 543.691615] env[65471]: DEBUG oslo_concurrency.lockutils [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 543.691733] env[65471]: DEBUG oslo_concurrency.lockutils [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 543.691877] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 543.691987] env[65471]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=65471) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 543.692106] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 543.712587] env[65471]: DEBUG networking_nsxv3.common.locking [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.713031] env[65471]: DEBUG oslo_concurrency.lockutils [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 543.713031] env[65471]: DEBUG oslo_concurrency.lockutils [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 543.713248] env[65471]: DEBUG oslo_concurrency.lockutils [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 543.713462] env[65471]: DEBUG oslo_concurrency.lockutils [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 543.713629] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 543.733242] env[65471]: DEBUG networking_nsxv3.common.locking [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.733492] env[65471]: DEBUG oslo_concurrency.lockutils [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 543.733492] env[65471]: DEBUG oslo_concurrency.lockutils [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 543.733782] env[65471]: DEBUG oslo_concurrency.lockutils [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 543.733923] env[65471]: DEBUG oslo_concurrency.lockutils [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 543.734077] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 543.753454] env[65471]: DEBUG networking_nsxv3.common.locking [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.753673] env[65471]: DEBUG oslo_concurrency.lockutils [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] Acquiring lock "Address Group" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 543.753717] env[65471]: DEBUG oslo_concurrency.lockutils [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] Acquired lock "Address Group" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 543.753993] env[65471]: DEBUG oslo_concurrency.lockutils [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] Acquired external semaphore "Address Group" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 543.754155] env[65471]: DEBUG oslo_concurrency.lockutils [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] Releasing lock "Address Group" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 543.754309] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 543.754411] env[65471]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65471) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 543.754513] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 543.773836] env[65471]: DEBUG networking_nsxv3.common.locking [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.774043] env[65471]: DEBUG oslo_concurrency.lockutils [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] Acquiring lock "Segment QoS" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 543.774147] env[65471]: DEBUG oslo_concurrency.lockutils [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] Acquired lock "Segment QoS" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 543.774409] env[65471]: DEBUG oslo_concurrency.lockutils [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] Acquired external semaphore "Segment QoS" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 543.774532] env[65471]: DEBUG oslo_concurrency.lockutils [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] Releasing lock "Segment QoS" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 543.774673] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 543.774773] env[65471]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=65471) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 543.774875] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 543.797179] env[65471]: DEBUG networking_nsxv3.common.locking [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.797562] env[65471]: DEBUG oslo_concurrency.lockutils [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 543.797562] env[65471]: DEBUG oslo_concurrency.lockutils [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 543.797763] env[65471]: DEBUG oslo_concurrency.lockutils [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 543.797891] env[65471]: DEBUG oslo_concurrency.lockutils [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 543.798098] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 543.798232] env[65471]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65471) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 543.798354] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] Inventory metadata have been refreshed. [ 543.798452] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] Dryrun:True. Metadata refresh completed. [ 543.798568] env[65471]: DEBUG oslo_concurrency.lockutils [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] Releasing lock "all" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 543.800326] env[65471]: INFO neutron.agent.agent_extensions_manager [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] Loaded agent extensions: [] [ 543.801041] env[65471]: DEBUG neutron_lib.callbacks.manager [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=65471) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 543.852470] env[65471]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] NSXv3 Agent Agent RPC Daemon Started! [ 543.852615] env[65471]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] NSXv3 Agent Agent loop - iteration:0 started [ 543.852688] env[65471]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] NSXv3 Agent Agent out of sync with plugin! [ 548.802253] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 548.802592] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 553.803842] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 553.804243] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 558.804653] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 558.805031] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 558.851783] env[65471]: INFO networking_nsxv3.common.synchronization [None req-0c83723b-4ea2-4304-b0da-bfe9d7efada4 demo admin] Enqueued Resource ID: 53d451e3-f4e5-4406-9255-223a537a92f2 with Priority: HIGHEST for action security_group_rules [ 558.852091] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53d451e3-f4e5-4406-9255-223a537a92f2 with Priority: HIGHEST for action security_group_rules [ 558.852392] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-53d451e3-f4e5-4406-9255-223a537a92f2 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 558.852574] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-53d451e3-f4e5-4406-9255-223a537a92f2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 558.852613] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-53d451e3-f4e5-4406-9255-223a537a92f2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 558.852933] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-53d451e3-f4e5-4406-9255-223a537a92f2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 558.853027] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('53d451e3-f4e5-4406-9255-223a537a92f2',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 559.375789] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 559.376087] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 559.376087] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 559.376293] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 559.376407] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 559.376517] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 53d451e3-f4e5-4406-9255-223a537a92f2 already deleted. [ 559.376591] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-53d451e3-f4e5-4406-9255-223a537a92f2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 563.853135] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 563.853543] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 564.803798] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.804156] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.804156] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 564.804332] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 564.804470] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 565.307052] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 565.809263] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 566.311333] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 566.311852] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 567.153120] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.153371] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.153371] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 567.153548] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 567.164176] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 567.165087] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 567.166060] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 567.184838] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.184998] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.185054] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 567.185260] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 567.185346] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 567.185510] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 567.185582] env[65471]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65471) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 567.185626] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 567.205584] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.205831] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.205831] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 567.205972] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 567.206123] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 567.206237] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 567.228909] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.229143] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.229233] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 567.229428] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 567.229536] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 567.229649] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 567.249654] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.249877] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.249877] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 567.250089] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 567.250193] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 567.250465] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 567.250465] env[65471]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65471) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 567.250465] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 567.274531] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.274851] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.274851] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 567.275069] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 567.275241] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 567.275414] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 567.275528] env[65471]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65471) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 567.275643] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 567.301908] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.302191] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.302191] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 567.302342] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 567.302450] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 567.302568] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 567.302640] env[65471]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65471) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 567.302704] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 567.302769] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 567.302844] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 567.302905] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 567.302967] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 567.303247] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 567.303310] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 567.303377] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 567.324427] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.324872] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.324872] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 567.324872] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 567.324974] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 567.325155] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 567.348422] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.348694] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.348694] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 567.348838] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 567.348940] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 567.384590] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 568.854666] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 568.855070] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 573.855730] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 573.856181] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 578.856635] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 578.856635] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 583.856946] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 583.857277] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 586.950194] env[65471]: INFO networking_nsxv3.common.synchronization [None req-e92a0e14-e0c4-4918-85f4-88e245fdbcd2 None None] Enqueued Resource ID: 5bfa3436-a60e-45cc-b9f3-034e179585d0 with Priority: HIGHEST for action port [ 586.951022] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bfa3436-a60e-45cc-b9f3-034e179585d0 with Priority: HIGHEST for action port [ 586.951022] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-5bfa3436-a60e-45cc-b9f3-034e179585d0 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.951022] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5bfa3436-a60e-45cc-b9f3-034e179585d0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.951022] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5bfa3436-a60e-45cc-b9f3-034e179585d0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.951191] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5bfa3436-a60e-45cc-b9f3-034e179585d0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.951268] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5bfa3436-a60e-45cc-b9f3-034e179585d0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.454400] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5bfa3436-a60e-45cc-b9f3-034e179585d0 [ 587.454643] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.454776] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.454846] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.455088] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.455407] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.455407] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5bfa3436-a60e-45cc-b9f3-034e179585d0 already deleted. [ 587.455407] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5bfa3436-a60e-45cc-b9f3-034e179585d0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.745926] env[65471]: INFO networking_nsxv3.common.synchronization [None req-f2ac3f89-3cc2-4e29-b451-8d4cf194fd7f None None] Enqueued Resource ID: a3ed67b8-9c90-4d05-b755-8bdcde2972bd with Priority: HIGHEST for action port [ 588.745926] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3ed67b8-9c90-4d05-b755-8bdcde2972bd with Priority: HIGHEST for action port [ 588.745926] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-a3ed67b8-9c90-4d05-b755-8bdcde2972bd taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.745926] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a3ed67b8-9c90-4d05-b755-8bdcde2972bd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.745926] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a3ed67b8-9c90-4d05-b755-8bdcde2972bd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.745926] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a3ed67b8-9c90-4d05-b755-8bdcde2972bd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.746779] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3ed67b8-9c90-4d05-b755-8bdcde2972bd',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.249559] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a3ed67b8-9c90-4d05-b755-8bdcde2972bd [ 589.249559] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.249833] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.249833] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.249953] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.250070] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.250173] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a3ed67b8-9c90-4d05-b755-8bdcde2972bd already deleted. [ 589.250288] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a3ed67b8-9c90-4d05-b755-8bdcde2972bd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.711024] env[65471]: INFO networking_nsxv3.common.synchronization [None req-6eda79b4-fd8b-4fb4-a713-28b629a1d953 None None] Enqueued Resource ID: b9025f74-d572-4eb6-96a3-1e318cd082a5 with Priority: HIGHEST for action port [ 591.711024] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9025f74-d572-4eb6-96a3-1e318cd082a5 with Priority: HIGHEST for action port [ 591.711024] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-b9025f74-d572-4eb6-96a3-1e318cd082a5 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.711024] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b9025f74-d572-4eb6-96a3-1e318cd082a5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.711024] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b9025f74-d572-4eb6-96a3-1e318cd082a5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.711024] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b9025f74-d572-4eb6-96a3-1e318cd082a5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.711024] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9025f74-d572-4eb6-96a3-1e318cd082a5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.214459] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b9025f74-d572-4eb6-96a3-1e318cd082a5 [ 592.214705] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.214848] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.214918] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.215161] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.215254] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.215349] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b9025f74-d572-4eb6-96a3-1e318cd082a5 already deleted. [ 592.215463] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b9025f74-d572-4eb6-96a3-1e318cd082a5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.345021] env[65471]: INFO networking_nsxv3.common.synchronization [None req-20667c84-97e5-48ff-8c12-1e4831af8082 None None] Enqueued Resource ID: b70faa04-ecb8-4317-af42-1384f62c5a4a with Priority: HIGHEST for action port [ 592.345021] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b70faa04-ecb8-4317-af42-1384f62c5a4a with Priority: HIGHEST for action port [ 592.345021] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-b70faa04-ecb8-4317-af42-1384f62c5a4a taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.345021] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b70faa04-ecb8-4317-af42-1384f62c5a4a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.345021] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b70faa04-ecb8-4317-af42-1384f62c5a4a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.345021] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b70faa04-ecb8-4317-af42-1384f62c5a4a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.345890] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b70faa04-ecb8-4317-af42-1384f62c5a4a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.449636] env[65471]: INFO networking_nsxv3.common.synchronization [None req-2627da3e-8818-4fdf-8191-e388af5ba31e None None] Enqueued Resource ID: 16e7b6b7-670b-4219-b8c1-ee6cd4b407df with Priority: HIGHEST for action port [ 592.449921] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16e7b6b7-670b-4219-b8c1-ee6cd4b407df with Priority: HIGHEST for action port [ 592.450736] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-16e7b6b7-670b-4219-b8c1-ee6cd4b407df taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.452118] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-16e7b6b7-670b-4219-b8c1-ee6cd4b407df" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.452118] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-16e7b6b7-670b-4219-b8c1-ee6cd4b407df" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.452118] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-16e7b6b7-670b-4219-b8c1-ee6cd4b407df" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.452118] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16e7b6b7-670b-4219-b8c1-ee6cd4b407df',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.848549] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b70faa04-ecb8-4317-af42-1384f62c5a4a [ 592.850202] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.850202] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.850202] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.850202] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.850202] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.850202] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b70faa04-ecb8-4317-af42-1384f62c5a4a already deleted. [ 592.850202] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b70faa04-ecb8-4317-af42-1384f62c5a4a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.954123] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 16e7b6b7-670b-4219-b8c1-ee6cd4b407df [ 592.954123] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.954123] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.954123] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.954319] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.954319] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.954463] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:16e7b6b7-670b-4219-b8c1-ee6cd4b407df already deleted. [ 592.954553] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-16e7b6b7-670b-4219-b8c1-ee6cd4b407df" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.171109] env[65471]: INFO networking_nsxv3.common.synchronization [None req-d60b2d4f-aca8-46be-a386-b3828d5f66c7 None None] Enqueued Resource ID: 04b208e7-d16d-4877-9fc4-5c230236f59a with Priority: HIGHEST for action port [ 593.171109] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04b208e7-d16d-4877-9fc4-5c230236f59a with Priority: HIGHEST for action port [ 593.171300] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-04b208e7-d16d-4877-9fc4-5c230236f59a taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.171426] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-04b208e7-d16d-4877-9fc4-5c230236f59a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.171495] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-04b208e7-d16d-4877-9fc4-5c230236f59a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.171815] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-04b208e7-d16d-4877-9fc4-5c230236f59a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.171815] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04b208e7-d16d-4877-9fc4-5c230236f59a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.674142] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 04b208e7-d16d-4877-9fc4-5c230236f59a [ 593.674381] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.674610] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.674610] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.674929] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.674929] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.675104] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:04b208e7-d16d-4877-9fc4-5c230236f59a already deleted. [ 593.675104] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-04b208e7-d16d-4877-9fc4-5c230236f59a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.072031] env[65471]: INFO networking_nsxv3.common.synchronization [None req-39b27f79-dfc7-49a7-b54d-d615c5538a37 None None] Enqueued Resource ID: 5166731f-a004-435e-a2a3-7c6cfd56bb29 with Priority: HIGHEST for action port [ 594.072594] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5166731f-a004-435e-a2a3-7c6cfd56bb29 with Priority: HIGHEST for action port [ 594.072898] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-5166731f-a004-435e-a2a3-7c6cfd56bb29 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.073835] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5166731f-a004-435e-a2a3-7c6cfd56bb29" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.073835] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5166731f-a004-435e-a2a3-7c6cfd56bb29" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.073835] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5166731f-a004-435e-a2a3-7c6cfd56bb29" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.073835] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5166731f-a004-435e-a2a3-7c6cfd56bb29',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.579451] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5166731f-a004-435e-a2a3-7c6cfd56bb29 [ 594.580315] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.580315] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.580315] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.580740] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.581052] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.581052] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5166731f-a004-435e-a2a3-7c6cfd56bb29 already deleted. [ 594.581143] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5166731f-a004-435e-a2a3-7c6cfd56bb29" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.951096] env[65471]: INFO networking_nsxv3.common.synchronization [None req-54c1e828-6887-42ff-9a50-c169eb089880 None None] Enqueued Resource ID: f3ef4e24-2c71-41d1-a906-6cfdd71feeb3 with Priority: HIGHEST for action port [ 594.952023] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3ef4e24-2c71-41d1-a906-6cfdd71feeb3 with Priority: HIGHEST for action port [ 594.952023] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-f3ef4e24-2c71-41d1-a906-6cfdd71feeb3 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.952023] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f3ef4e24-2c71-41d1-a906-6cfdd71feeb3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.952230] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f3ef4e24-2c71-41d1-a906-6cfdd71feeb3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.952308] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f3ef4e24-2c71-41d1-a906-6cfdd71feeb3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.952381] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3ef4e24-2c71-41d1-a906-6cfdd71feeb3',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.118838] env[65471]: INFO networking_nsxv3.common.synchronization [None req-e5a17656-4e07-426a-a60d-b4f8e7677979 None None] Enqueued Resource ID: dda89876-dd38-4db3-bf46-722564ea12e5 with Priority: HIGHEST for action port [ 595.119119] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dda89876-dd38-4db3-bf46-722564ea12e5 with Priority: HIGHEST for action port [ 595.120153] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-dda89876-dd38-4db3-bf46-722564ea12e5 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.120300] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dda89876-dd38-4db3-bf46-722564ea12e5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.120338] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dda89876-dd38-4db3-bf46-722564ea12e5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.121350] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dda89876-dd38-4db3-bf46-722564ea12e5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.121350] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dda89876-dd38-4db3-bf46-722564ea12e5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.457179] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f3ef4e24-2c71-41d1-a906-6cfdd71feeb3 [ 595.457179] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.457179] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.457179] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.457179] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.457748] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.457748] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f3ef4e24-2c71-41d1-a906-6cfdd71feeb3 already deleted. [ 595.457826] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f3ef4e24-2c71-41d1-a906-6cfdd71feeb3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.623414] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dda89876-dd38-4db3-bf46-722564ea12e5 [ 595.623641] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.623778] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.623866] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.624071] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.624157] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.624251] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dda89876-dd38-4db3-bf46-722564ea12e5 already deleted. [ 595.624329] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dda89876-dd38-4db3-bf46-722564ea12e5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.479989] env[65471]: INFO networking_nsxv3.common.synchronization [None req-2397e3f9-459e-49d3-b4ba-75a02b7d9c89 None None] Enqueued Resource ID: 8ee038b2-483b-4a06-8c3f-8e4d14f1b8d9 with Priority: HIGHEST for action port [ 596.480523] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ee038b2-483b-4a06-8c3f-8e4d14f1b8d9 with Priority: HIGHEST for action port [ 596.480823] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-8ee038b2-483b-4a06-8c3f-8e4d14f1b8d9 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.480949] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8ee038b2-483b-4a06-8c3f-8e4d14f1b8d9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.481061] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8ee038b2-483b-4a06-8c3f-8e4d14f1b8d9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.481271] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8ee038b2-483b-4a06-8c3f-8e4d14f1b8d9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.481353] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ee038b2-483b-4a06-8c3f-8e4d14f1b8d9',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.712967] env[65471]: INFO networking_nsxv3.common.synchronization [None req-90ba1b28-08c9-451c-8741-ad1ef89aec6e None None] Enqueued Resource ID: 9e2eceac-1f82-455d-a065-e068a96fe494 with Priority: HIGHEST for action port [ 596.713633] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e2eceac-1f82-455d-a065-e068a96fe494 with Priority: HIGHEST for action port [ 596.713944] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-9e2eceac-1f82-455d-a065-e068a96fe494 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.715902] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9e2eceac-1f82-455d-a065-e068a96fe494" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.715902] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9e2eceac-1f82-455d-a065-e068a96fe494" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.715902] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9e2eceac-1f82-455d-a065-e068a96fe494" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.715902] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e2eceac-1f82-455d-a065-e068a96fe494',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.982966] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8ee038b2-483b-4a06-8c3f-8e4d14f1b8d9 [ 596.983182] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.984547] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.984547] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.984547] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.984547] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.984547] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8ee038b2-483b-4a06-8c3f-8e4d14f1b8d9 already deleted. [ 596.984547] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8ee038b2-483b-4a06-8c3f-8e4d14f1b8d9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.216601] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9e2eceac-1f82-455d-a065-e068a96fe494 [ 597.216874] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.217160] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.217160] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.217393] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.217393] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.217507] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9e2eceac-1f82-455d-a065-e068a96fe494 already deleted. [ 597.217555] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9e2eceac-1f82-455d-a065-e068a96fe494" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.703628] env[65471]: INFO networking_nsxv3.common.synchronization [None req-db1a55a6-826a-4c8e-b67e-db194eb88c67 None None] Enqueued Resource ID: be00534e-e113-4401-aae5-3259ae8340b7 with Priority: HIGHEST for action port [ 598.703904] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be00534e-e113-4401-aae5-3259ae8340b7 with Priority: HIGHEST for action port [ 598.704811] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-be00534e-e113-4401-aae5-3259ae8340b7 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.705047] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-be00534e-e113-4401-aae5-3259ae8340b7" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.705047] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-be00534e-e113-4401-aae5-3259ae8340b7" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.705800] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-be00534e-e113-4401-aae5-3259ae8340b7" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.705800] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be00534e-e113-4401-aae5-3259ae8340b7',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.022620] env[65471]: INFO networking_nsxv3.common.synchronization [None req-a70f32f5-9d5b-4369-8b43-15d1fce7bed9 None None] Enqueued Resource ID: b241b520-6407-4058-8ef1-17b78b24421e with Priority: HIGHEST for action port [ 599.023271] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b241b520-6407-4058-8ef1-17b78b24421e with Priority: HIGHEST for action port [ 599.023444] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-b241b520-6407-4058-8ef1-17b78b24421e taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.023569] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b241b520-6407-4058-8ef1-17b78b24421e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.023637] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b241b520-6407-4058-8ef1-17b78b24421e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.023880] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b241b520-6407-4058-8ef1-17b78b24421e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.023964] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b241b520-6407-4058-8ef1-17b78b24421e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.208502] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port be00534e-e113-4401-aae5-3259ae8340b7 [ 599.209123] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.210152] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.210152] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.210152] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.210152] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.210152] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:be00534e-e113-4401-aae5-3259ae8340b7 already deleted. [ 599.210152] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-be00534e-e113-4401-aae5-3259ae8340b7" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.526351] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b241b520-6407-4058-8ef1-17b78b24421e [ 599.526452] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.526589] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.526675] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.526899] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.530016] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.530016] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b241b520-6407-4058-8ef1-17b78b24421e already deleted. [ 599.530016] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b241b520-6407-4058-8ef1-17b78b24421e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.595014] env[65471]: INFO networking_nsxv3.common.synchronization [None req-473bc05d-00fc-4949-a900-56e886535f3c None None] Enqueued Resource ID: 9487674b-8601-4bfa-b41d-49b1422716b0 with Priority: HIGHEST for action port [ 599.595275] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9487674b-8601-4bfa-b41d-49b1422716b0 with Priority: HIGHEST for action port [ 599.596994] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-9487674b-8601-4bfa-b41d-49b1422716b0 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.597782] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9487674b-8601-4bfa-b41d-49b1422716b0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.597864] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9487674b-8601-4bfa-b41d-49b1422716b0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.598804] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9487674b-8601-4bfa-b41d-49b1422716b0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.598891] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9487674b-8601-4bfa-b41d-49b1422716b0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.100823] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9487674b-8601-4bfa-b41d-49b1422716b0 [ 600.101131] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.101232] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.101299] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.101514] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.101602] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.101704] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9487674b-8601-4bfa-b41d-49b1422716b0 already deleted. [ 600.101937] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9487674b-8601-4bfa-b41d-49b1422716b0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.256716] env[65471]: INFO networking_nsxv3.common.synchronization [None req-f8272446-a168-4265-88b9-111841c84e93 None None] Enqueued Resource ID: 4bd205a0-c2eb-406a-9a98-e1b33a7b6ebb with Priority: HIGHEST for action port [ 601.257053] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bd205a0-c2eb-406a-9a98-e1b33a7b6ebb with Priority: HIGHEST for action port [ 601.258685] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-4bd205a0-c2eb-406a-9a98-e1b33a7b6ebb taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.258685] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4bd205a0-c2eb-406a-9a98-e1b33a7b6ebb" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.258685] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4bd205a0-c2eb-406a-9a98-e1b33a7b6ebb" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.258685] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4bd205a0-c2eb-406a-9a98-e1b33a7b6ebb" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.258685] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4bd205a0-c2eb-406a-9a98-e1b33a7b6ebb',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.762318] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4bd205a0-c2eb-406a-9a98-e1b33a7b6ebb [ 601.762702] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.762702] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.762702] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.763014] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.763014] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.763106] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4bd205a0-c2eb-406a-9a98-e1b33a7b6ebb already deleted. [ 601.763182] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4bd205a0-c2eb-406a-9a98-e1b33a7b6ebb" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.853055] env[65471]: INFO networking_nsxv3.common.synchronization [None req-2d52239e-4e39-4f58-9b59-01d5620b47b8 None None] Enqueued Resource ID: 5cfd0d5b-6a66-48bd-ac1f-3401fcfb921d with Priority: HIGHEST for action port [ 601.853621] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5cfd0d5b-6a66-48bd-ac1f-3401fcfb921d with Priority: HIGHEST for action port [ 601.853858] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-5cfd0d5b-6a66-48bd-ac1f-3401fcfb921d taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.853979] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5cfd0d5b-6a66-48bd-ac1f-3401fcfb921d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.854070] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5cfd0d5b-6a66-48bd-ac1f-3401fcfb921d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.854416] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5cfd0d5b-6a66-48bd-ac1f-3401fcfb921d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.854416] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5cfd0d5b-6a66-48bd-ac1f-3401fcfb921d',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.116581] env[65471]: INFO networking_nsxv3.common.synchronization [None req-bce4feee-a099-4f88-8785-7aee513aeb8e None None] Enqueued Resource ID: 1bb6364b-8aea-469b-934d-93894bcb736c with Priority: HIGHEST for action port [ 602.117144] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bb6364b-8aea-469b-934d-93894bcb736c with Priority: HIGHEST for action port [ 602.117433] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-1bb6364b-8aea-469b-934d-93894bcb736c taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.117560] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1bb6364b-8aea-469b-934d-93894bcb736c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.118061] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1bb6364b-8aea-469b-934d-93894bcb736c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.118061] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1bb6364b-8aea-469b-934d-93894bcb736c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.118843] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1bb6364b-8aea-469b-934d-93894bcb736c',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.357922] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5cfd0d5b-6a66-48bd-ac1f-3401fcfb921d [ 602.359358] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.359358] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.359358] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.359358] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.359358] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.359358] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5cfd0d5b-6a66-48bd-ac1f-3401fcfb921d already deleted. [ 602.359358] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5cfd0d5b-6a66-48bd-ac1f-3401fcfb921d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.621939] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1bb6364b-8aea-469b-934d-93894bcb736c [ 602.621939] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.621939] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.621939] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.622387] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.622387] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.622387] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1bb6364b-8aea-469b-934d-93894bcb736c already deleted. [ 602.622387] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1bb6364b-8aea-469b-934d-93894bcb736c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.170091] env[65471]: INFO networking_nsxv3.common.synchronization [None req-e86708f9-1f98-4a6f-b8fb-7f6b2433aa61 None None] Enqueued Resource ID: 6c6c6053-3da7-42c1-b9da-5e83c9c7580c with Priority: HIGHEST for action port [ 603.170625] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c6c6053-3da7-42c1-b9da-5e83c9c7580c with Priority: HIGHEST for action port [ 603.170930] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-6c6c6053-3da7-42c1-b9da-5e83c9c7580c taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.174418] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6c6c6053-3da7-42c1-b9da-5e83c9c7580c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.174418] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6c6c6053-3da7-42c1-b9da-5e83c9c7580c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.174418] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6c6c6053-3da7-42c1-b9da-5e83c9c7580c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.174418] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c6c6053-3da7-42c1-b9da-5e83c9c7580c',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.676118] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6c6c6053-3da7-42c1-b9da-5e83c9c7580c [ 603.676459] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.676640] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.676735] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.677073] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.678391] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.678391] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6c6c6053-3da7-42c1-b9da-5e83c9c7580c already deleted. [ 603.678391] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6c6c6053-3da7-42c1-b9da-5e83c9c7580c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.074542] env[65471]: INFO networking_nsxv3.common.synchronization [req-2db40050-0f74-473e-a71d-c3afbf19452b req-284494dc-9549-463e-85a2-e2c705b420ca tempest-DeleteServersAdminTestJSON-1981732508 tempest-DeleteServersAdminTestJSON-1981732508-project-member] Enqueued Resource ID: 49f0917b-c43e-421e-9ccf-fe8487bf2b37 with Priority: HIGHEST for action security_group_members [ 604.074542] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49f0917b-c43e-421e-9ccf-fe8487bf2b37 with Priority: HIGHEST for action security_group_members [ 604.074790] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-49f0917b-c43e-421e-9ccf-fe8487bf2b37 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.074907] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49f0917b-c43e-421e-9ccf-fe8487bf2b37" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.074963] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49f0917b-c43e-421e-9ccf-fe8487bf2b37" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.075247] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49f0917b-c43e-421e-9ccf-fe8487bf2b37" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.075402] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.075534] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.075591] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.075697] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.075775] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.075861] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49f0917b-c43e-421e-9ccf-fe8487bf2b37',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.109027] env[65471]: INFO networking_nsxv3.common.synchronization [None req-3c4c9910-f64e-40fc-aeff-eada182185a1 None None] Enqueued Resource ID: 8c7dd003-5ab7-4d2b-bb69-8c575ca3c86b with Priority: HIGHEST for action port [ 604.109653] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c7dd003-5ab7-4d2b-bb69-8c575ca3c86b with Priority: HIGHEST for action port [ 604.110050] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-8c7dd003-5ab7-4d2b-bb69-8c575ca3c86b taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.110180] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8c7dd003-5ab7-4d2b-bb69-8c575ca3c86b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.110250] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8c7dd003-5ab7-4d2b-bb69-8c575ca3c86b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.110484] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8c7dd003-5ab7-4d2b-bb69-8c575ca3c86b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.110567] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c7dd003-5ab7-4d2b-bb69-8c575ca3c86b',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.582696] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.582894] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.582985] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.583413] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.583515] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.583718] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.583825] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.583898] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.584072] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.584151] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.584238] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49f0917b-c43e-421e-9ccf-fe8487bf2b37 already deleted. [ 604.584318] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49f0917b-c43e-421e-9ccf-fe8487bf2b37" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.614415] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8c7dd003-5ab7-4d2b-bb69-8c575ca3c86b [ 604.614652] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.614983] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.614983] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.615246] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.615246] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.615330] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8c7dd003-5ab7-4d2b-bb69-8c575ca3c86b already deleted. [ 604.615367] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8c7dd003-5ab7-4d2b-bb69-8c575ca3c86b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.359176] env[65471]: INFO networking_nsxv3.common.synchronization [None req-c6e28c0f-896d-4577-a7ce-1c150e29fe84 None None] Enqueued Resource ID: 070bc7ed-25e4-45a4-a6bc-903055792194 with Priority: HIGHEST for action port [ 605.359402] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 070bc7ed-25e4-45a4-a6bc-903055792194 with Priority: HIGHEST for action port [ 605.359595] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-070bc7ed-25e4-45a4-a6bc-903055792194 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.359670] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-070bc7ed-25e4-45a4-a6bc-903055792194" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.359721] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-070bc7ed-25e4-45a4-a6bc-903055792194" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.360573] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-070bc7ed-25e4-45a4-a6bc-903055792194" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.360725] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('070bc7ed-25e4-45a4-a6bc-903055792194',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.582502] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock network-647 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.582696] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "network-647" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.582816] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "network-647" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.583135] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "network-647" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.583382] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.583530] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.583637] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.583968] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.583968] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.584294] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 605.584414] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 605.584473] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 605.586079] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 605.586079] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 605.586079] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 605.586079] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 605.612289] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 605.612289] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 605.612289] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 605.612289] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "network-647" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.612289] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock port-96783aec-b530-4108-bfe8-710ba89369bd taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.612289] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "port-96783aec-b530-4108-bfe8-710ba89369bd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.612289] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "port-96783aec-b530-4108-bfe8-710ba89369bd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.614563] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "port-96783aec-b530-4108-bfe8-710ba89369bd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.614563] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96783aec-b530-4108-bfe8-710ba89369bd',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.863738] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 070bc7ed-25e4-45a4-a6bc-903055792194 [ 605.864843] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.864843] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.864843] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.864843] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.864843] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.864843] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:070bc7ed-25e4-45a4-a6bc-903055792194 already deleted. [ 605.864843] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-070bc7ed-25e4-45a4-a6bc-903055792194" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.903682] env[65471]: INFO networking_nsxv3.common.synchronization [None req-51993290-63ce-4bf7-becd-f4115815a977 None None] Enqueued Resource ID: 82423b54-1cec-456f-9509-c8ab271dbf63 with Priority: HIGHEST for action port [ 605.904506] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82423b54-1cec-456f-9509-c8ab271dbf63 with Priority: HIGHEST for action port [ 605.904983] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-82423b54-1cec-456f-9509-c8ab271dbf63 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.905195] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82423b54-1cec-456f-9509-c8ab271dbf63" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.905195] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82423b54-1cec-456f-9509-c8ab271dbf63" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.905418] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82423b54-1cec-456f-9509-c8ab271dbf63" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.905561] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82423b54-1cec-456f-9509-c8ab271dbf63',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.118166] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.118388] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.118514] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.118787] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.119016] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.119172] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Segment Port 96783aec-b530-4108-bfe8-710ba89369bd not found, creating... [ 606.119423] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.119561] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.119670] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.119905] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.120190] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.120469] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.120554] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.120691] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.120897] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.121030] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.123035] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Resource: SegmentPort with ID: 96783aec-b530-4108-bfe8-710ba89369bd is going to be created. [ 606.160244] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.160244] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.160446] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.161053] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.161053] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.161053] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "port-96783aec-b530-4108-bfe8-710ba89369bd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.163629] env[65471]: INFO networking_nsxv3.common.synchronization [None req-171dfdc0-ea89-4d5e-8041-3f8c50f5eac7 None None] Enqueued Resource ID: 6dc77b47-1968-4c76-945d-1e13a19ad735 with Priority: HIGHEST for action port [ 606.164326] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dc77b47-1968-4c76-945d-1e13a19ad735 with Priority: HIGHEST for action port [ 606.164612] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-6dc77b47-1968-4c76-945d-1e13a19ad735 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.164728] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6dc77b47-1968-4c76-945d-1e13a19ad735" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.165035] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6dc77b47-1968-4c76-945d-1e13a19ad735" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.165140] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6dc77b47-1968-4c76-945d-1e13a19ad735" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.165242] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6dc77b47-1968-4c76-945d-1e13a19ad735',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.408980] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 82423b54-1cec-456f-9509-c8ab271dbf63 [ 606.409378] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.409473] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.409473] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.409701] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.409840] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.409982] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:82423b54-1cec-456f-9509-c8ab271dbf63 already deleted. [ 606.410083] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82423b54-1cec-456f-9509-c8ab271dbf63" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.667338] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6dc77b47-1968-4c76-945d-1e13a19ad735 [ 606.667562] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.667692] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.667754] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.667967] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.668066] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.668189] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6dc77b47-1968-4c76-945d-1e13a19ad735 already deleted. [ 606.668269] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6dc77b47-1968-4c76-945d-1e13a19ad735" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.691081] env[65471]: INFO networking_nsxv3.common.synchronization [None req-a13348e8-2c41-4291-afa3-d0e767a6b987 tempest-ServerActionsTestJSON-1061383532 tempest-ServerActionsTestJSON-1061383532-project-member] Enqueued Resource ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 with Priority: HIGHEST for action security_group_rules [ 606.691351] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 with Priority: HIGHEST for action security_group_rules [ 606.692630] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-401f7079-c4c2-4951-b6ae-bc1cfbb23228 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.692630] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.692630] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.692630] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.692630] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('401f7079-c4c2-4951-b6ae-bc1cfbb23228',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.832191] env[65471]: INFO networking_nsxv3.common.synchronization [None req-9c6389fb-4f61-4ba0-8bba-b85920bafcdf None None] Enqueued Resource ID: 68e9f90e-e1cd-4391-ac09-bde39221e126 with Priority: HIGHEST for action port [ 606.833065] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68e9f90e-e1cd-4391-ac09-bde39221e126 with Priority: HIGHEST for action port [ 606.833065] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-68e9f90e-e1cd-4391-ac09-bde39221e126 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.833226] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-68e9f90e-e1cd-4391-ac09-bde39221e126" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.833226] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-68e9f90e-e1cd-4391-ac09-bde39221e126" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.834202] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-68e9f90e-e1cd-4391-ac09-bde39221e126" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.834202] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68e9f90e-e1cd-4391-ac09-bde39221e126',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.844508] env[65471]: INFO networking_nsxv3.common.synchronization [None req-f6d46a5f-b610-4c2a-9a43-207bf377d6b9 tempest-ServerActionsTestJSON-1061383532 tempest-ServerActionsTestJSON-1061383532-project-member] Enqueued Resource ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 with Priority: HIGHEST for action security_group_rules [ 606.844978] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 with Priority: HIGHEST for action security_group_rules [ 606.845291] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-401f7079-c4c2-4951-b6ae-bc1cfbb23228 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.845401] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.927367] env[65471]: INFO networking_nsxv3.common.synchronization [req-2db40050-0f74-473e-a71d-c3afbf19452b req-1774e911-a559-4198-b5a8-e500d41958d3 service nova] Enqueued Resource ID: 49f0917b-c43e-421e-9ccf-fe8487bf2b37 with Priority: HIGHEST for action security_group_rules [ 606.927785] env[65471]: INFO networking_nsxv3.common.synchronization [req-2db40050-0f74-473e-a71d-c3afbf19452b req-1774e911-a559-4198-b5a8-e500d41958d3 service nova] Enqueued Resource ID: 49f0917b-c43e-421e-9ccf-fe8487bf2b37 with Priority: HIGHEST for action security_group_members [ 606.927785] env[65471]: INFO networking_nsxv3.common.synchronization [req-2db40050-0f74-473e-a71d-c3afbf19452b req-1774e911-a559-4198-b5a8-e500d41958d3 service nova] Enqueued Resource ID: 96783aec-b530-4108-bfe8-710ba89369bd with Priority: HIGHEST for action port [ 606.928250] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49f0917b-c43e-421e-9ccf-fe8487bf2b37 with Priority: HIGHEST for action security_group_rules [ 606.928380] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49f0917b-c43e-421e-9ccf-fe8487bf2b37 with Priority: HIGHEST for action security_group_members [ 606.928380] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96783aec-b530-4108-bfe8-710ba89369bd with Priority: HIGHEST for action port [ 606.930599] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49f0917b-c43e-421e-9ccf-fe8487bf2b37 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.930599] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49f0917b-c43e-421e-9ccf-fe8487bf2b37" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.930599] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49f0917b-c43e-421e-9ccf-fe8487bf2b37" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.930599] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49f0917b-c43e-421e-9ccf-fe8487bf2b37" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.930599] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49f0917b-c43e-421e-9ccf-fe8487bf2b37',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.930599] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-49f0917b-c43e-421e-9ccf-fe8487bf2b37 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.930969] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49f0917b-c43e-421e-9ccf-fe8487bf2b37" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.930969] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49f0917b-c43e-421e-9ccf-fe8487bf2b37" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.930969] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49f0917b-c43e-421e-9ccf-fe8487bf2b37" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.931060] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.931125] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.931505] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.931505] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.931505] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.931632] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49f0917b-c43e-421e-9ccf-fe8487bf2b37',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.933567] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-96783aec-b530-4108-bfe8-710ba89369bd taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.933679] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-96783aec-b530-4108-bfe8-710ba89369bd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.933752] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-96783aec-b530-4108-bfe8-710ba89369bd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.933908] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-96783aec-b530-4108-bfe8-710ba89369bd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.933983] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96783aec-b530-4108-bfe8-710ba89369bd',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.216154] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.217330] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.217445] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.217681] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.217782] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.218040] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 already deleted. [ 607.218040] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.218144] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.218328] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.218374] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('401f7079-c4c2-4951-b6ae-bc1cfbb23228',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.338025] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 68e9f90e-e1cd-4391-ac09-bde39221e126 [ 607.338025] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.338025] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.338025] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.338025] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.338025] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.340361] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:68e9f90e-e1cd-4391-ac09-bde39221e126 already deleted. [ 607.340361] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-68e9f90e-e1cd-4391-ac09-bde39221e126" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.438022] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-49f0917b-c43e-421e-9ccf-fe8487bf2b37 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.438022] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49f0917b-c43e-421e-9ccf-fe8487bf2b37" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.452288] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('49f0917b-c43e-421e-9ccf-fe8487bf2b37',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.453339] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 96783aec-b530-4108-bfe8-710ba89369bd with status ACTIVE [ 607.453940] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.453940] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.453940] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.453940] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.454143] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.454183] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.454283] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.454341] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.454486] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.454558] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.454771] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.454903] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.454965] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.455357] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.455444] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.455552] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 96783aec-b530-4108-bfe8-710ba89369bd is going to be updated. [ 607.477965] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.478724] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.478882] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.479098] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.481016] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.481016] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-96783aec-b530-4108-bfe8-710ba89369bd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.745152] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.745429] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.745713] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.746260] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.746260] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.746383] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 already deleted. [ 607.746732] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.842021] env[65471]: INFO networking_nsxv3.common.synchronization [None req-97610f96-c21b-4398-9f0d-e9bcb1e3a0af None None] Enqueued Resource ID: 9fdd627a-7b0d-4e3d-a99d-82a439124230 with Priority: HIGHEST for action port [ 607.842021] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fdd627a-7b0d-4e3d-a99d-82a439124230 with Priority: HIGHEST for action port [ 607.844262] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-9fdd627a-7b0d-4e3d-a99d-82a439124230 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.844262] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9fdd627a-7b0d-4e3d-a99d-82a439124230" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.844262] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9fdd627a-7b0d-4e3d-a99d-82a439124230" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.844262] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9fdd627a-7b0d-4e3d-a99d-82a439124230" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.844262] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9fdd627a-7b0d-4e3d-a99d-82a439124230',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.958703] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('49f0917b-c43e-421e-9ccf-fe8487bf2b37',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.349247] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9fdd627a-7b0d-4e3d-a99d-82a439124230 [ 608.349494] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.349659] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.349732] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.349963] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.350776] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.350958] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9fdd627a-7b0d-4e3d-a99d-82a439124230 already deleted. [ 608.351082] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9fdd627a-7b0d-4e3d-a99d-82a439124230" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.464754] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.464754] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.465271] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.465271] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.465271] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.465271] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49f0917b-c43e-421e-9ccf-fe8487bf2b37 is going to be created. [ 608.549734] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.550472] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.550472] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.550472] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.550472] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.564506] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49f0917b-c43e-421e-9ccf-fe8487bf2b37 in Status: UNINITIALIZED for 2s [ 608.819801] env[65471]: INFO networking_nsxv3.common.synchronization [req-3e48ca09-3f4f-4779-947e-1da6432cc877 req-fc8e58e3-1e89-42a0-b4ea-049232c1bf89 tempest-SecurityGroupRulesNegativeTestJSON-1201449079 tempest-SecurityGroupRulesNegativeTestJSON-1201449079-project-member] Enqueued Resource ID: 829f39c6-400b-4750-b6ec-802cba0d62be with Priority: HIGHEST for action security_group_rules [ 608.819968] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 829f39c6-400b-4750-b6ec-802cba0d62be with Priority: HIGHEST for action security_group_rules [ 608.820419] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-829f39c6-400b-4750-b6ec-802cba0d62be taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.820419] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-829f39c6-400b-4750-b6ec-802cba0d62be" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.820609] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-829f39c6-400b-4750-b6ec-802cba0d62be" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.820784] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-829f39c6-400b-4750-b6ec-802cba0d62be" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.820784] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('829f39c6-400b-4750-b6ec-802cba0d62be',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.092767] env[65471]: INFO networking_nsxv3.common.synchronization [None req-064f27fc-d36b-4b80-b694-20d69e60b12f None None] Enqueued Resource ID: 45844580-22cb-47ec-ab5d-780fdf3feec9 with Priority: HIGHEST for action port [ 609.097527] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45844580-22cb-47ec-ab5d-780fdf3feec9 with Priority: HIGHEST for action port [ 609.097890] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-45844580-22cb-47ec-ab5d-780fdf3feec9 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.098049] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-45844580-22cb-47ec-ab5d-780fdf3feec9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.099040] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-45844580-22cb-47ec-ab5d-780fdf3feec9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.099040] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-45844580-22cb-47ec-ab5d-780fdf3feec9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.099040] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45844580-22cb-47ec-ab5d-780fdf3feec9',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.418309] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.418893] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.419089] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.419346] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.419475] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.419534] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 829f39c6-400b-4750-b6ec-802cba0d62be already deleted. [ 609.419604] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-829f39c6-400b-4750-b6ec-802cba0d62be" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.601280] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 45844580-22cb-47ec-ab5d-780fdf3feec9 [ 609.601557] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.601668] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.601726] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.601949] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.602054] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.602169] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:45844580-22cb-47ec-ab5d-780fdf3feec9 already deleted. [ 609.602225] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-45844580-22cb-47ec-ab5d-780fdf3feec9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.709285] env[65471]: INFO networking_nsxv3.common.synchronization [None req-5f4fb555-533a-4a38-a4c4-fff23bc0535a None None] Enqueued Resource ID: d0f181fc-4909-4d17-afc9-97059bd3aeeb with Priority: HIGHEST for action port [ 609.709817] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0f181fc-4909-4d17-afc9-97059bd3aeeb with Priority: HIGHEST for action port [ 609.710132] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-d0f181fc-4909-4d17-afc9-97059bd3aeeb taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.710258] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d0f181fc-4909-4d17-afc9-97059bd3aeeb" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.710326] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d0f181fc-4909-4d17-afc9-97059bd3aeeb" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.711771] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d0f181fc-4909-4d17-afc9-97059bd3aeeb" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.711771] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0f181fc-4909-4d17-afc9-97059bd3aeeb',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.868211] env[65471]: INFO networking_nsxv3.common.synchronization [None req-c8862eda-bca8-4888-a11c-fd46b98284d7 tempest-VolumesAssistedSnapshotsTest-1042800714 tempest-VolumesAssistedSnapshotsTest-1042800714-project-member] Enqueued Resource ID: aa46e0ea-568f-4c50-a725-6d162fee238a with Priority: HIGHEST for action security_group_rules [ 609.868719] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa46e0ea-568f-4c50-a725-6d162fee238a with Priority: HIGHEST for action security_group_rules [ 609.869247] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa46e0ea-568f-4c50-a725-6d162fee238a taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.869247] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa46e0ea-568f-4c50-a725-6d162fee238a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.869541] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa46e0ea-568f-4c50-a725-6d162fee238a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.869541] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa46e0ea-568f-4c50-a725-6d162fee238a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.869604] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa46e0ea-568f-4c50-a725-6d162fee238a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.072100] env[65471]: INFO networking_nsxv3.common.synchronization [None req-0c4d9390-4874-4e94-9cea-a1d6a8645818 tempest-VolumesAssistedSnapshotsTest-1042800714 tempest-VolumesAssistedSnapshotsTest-1042800714-project-member] Enqueued Resource ID: aa46e0ea-568f-4c50-a725-6d162fee238a with Priority: HIGHEST for action security_group_rules [ 610.073010] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa46e0ea-568f-4c50-a725-6d162fee238a with Priority: HIGHEST for action security_group_rules [ 610.073580] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa46e0ea-568f-4c50-a725-6d162fee238a taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.073580] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa46e0ea-568f-4c50-a725-6d162fee238a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.214244] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d0f181fc-4909-4d17-afc9-97059bd3aeeb [ 610.214244] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.214244] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.214244] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.214244] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.214244] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.214244] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d0f181fc-4909-4d17-afc9-97059bd3aeeb already deleted. [ 610.214244] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d0f181fc-4909-4d17-afc9-97059bd3aeeb" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.395060] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.395199] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.395325] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.395548] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.395648] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.395748] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa46e0ea-568f-4c50-a725-6d162fee238a already deleted. [ 610.395957] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa46e0ea-568f-4c50-a725-6d162fee238a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.396052] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa46e0ea-568f-4c50-a725-6d162fee238a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.396154] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa46e0ea-568f-4c50-a725-6d162fee238a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.396251] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa46e0ea-568f-4c50-a725-6d162fee238a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.476191] env[65471]: INFO networking_nsxv3.common.synchronization [None req-5147bb11-0a19-4cac-accc-8d89dc0a1ff6 None None] Enqueued Resource ID: 8074e02f-6556-4378-a2a6-4367af2b58b0 with Priority: HIGHEST for action port [ 610.476191] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8074e02f-6556-4378-a2a6-4367af2b58b0 with Priority: HIGHEST for action port [ 610.476933] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-8074e02f-6556-4378-a2a6-4367af2b58b0 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.477501] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8074e02f-6556-4378-a2a6-4367af2b58b0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.477991] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8074e02f-6556-4378-a2a6-4367af2b58b0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.478196] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8074e02f-6556-4378-a2a6-4367af2b58b0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.479107] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8074e02f-6556-4378-a2a6-4367af2b58b0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.577404] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49f0917b-c43e-421e-9ccf-fe8487bf2b37 in Status: SUCCESS [ 610.577644] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49f0917b-c43e-421e-9ccf-fe8487bf2b37" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.577942] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49f0917b-c43e-421e-9ccf-fe8487bf2b37" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.578054] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49f0917b-c43e-421e-9ccf-fe8487bf2b37" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.578294] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.578399] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.578399] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.578556] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.578635] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.578714] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49f0917b-c43e-421e-9ccf-fe8487bf2b37" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.578798] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('49f0917b-c43e-421e-9ccf-fe8487bf2b37',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.921516] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.921867] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.921867] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.921960] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.922033] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.922129] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa46e0ea-568f-4c50-a725-6d162fee238a already deleted. [ 610.922206] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa46e0ea-568f-4c50-a725-6d162fee238a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.980730] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8074e02f-6556-4378-a2a6-4367af2b58b0 [ 610.980978] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.981209] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.981209] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.981420] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.981511] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.981612] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8074e02f-6556-4378-a2a6-4367af2b58b0 already deleted. [ 610.981747] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8074e02f-6556-4378-a2a6-4367af2b58b0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.081956] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-49f0917b-c43e-421e-9ccf-fe8487bf2b37 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.081956] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49f0917b-c43e-421e-9ccf-fe8487bf2b37" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.081956] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49f0917b-c43e-421e-9ccf-fe8487bf2b37" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.081956] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49f0917b-c43e-421e-9ccf-fe8487bf2b37" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.082238] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.082238] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.082385] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.082385] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.082597] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.082597] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49f0917b-c43e-421e-9ccf-fe8487bf2b37" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.082698] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-49f0917b-c43e-421e-9ccf-fe8487bf2b37 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.082821] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49f0917b-c43e-421e-9ccf-fe8487bf2b37" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.082821] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49f0917b-c43e-421e-9ccf-fe8487bf2b37" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.084694] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49f0917b-c43e-421e-9ccf-fe8487bf2b37" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.084694] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.084694] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.084694] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.084694] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.084694] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.084694] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49f0917b-c43e-421e-9ccf-fe8487bf2b37" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.084694] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('49f0917b-c43e-421e-9ccf-fe8487bf2b37',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.194310] env[65471]: INFO networking_nsxv3.common.synchronization [req-414da022-07b4-46c4-9ef9-1d9681beacf3 req-f3b427d1-8efa-4d43-8074-b6283ebc3a10 tempest-ServerDiagnosticsTest-1950138792 tempest-ServerDiagnosticsTest-1950138792-project-member] Enqueued Resource ID: bbd99ac4-1db4-4ccf-af90-c6ef33212f88 with Priority: HIGHEST for action security_group_members [ 611.194511] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbd99ac4-1db4-4ccf-af90-c6ef33212f88 with Priority: HIGHEST for action security_group_members [ 611.194809] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbd99ac4-1db4-4ccf-af90-c6ef33212f88 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.194934] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbd99ac4-1db4-4ccf-af90-c6ef33212f88" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.194993] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbd99ac4-1db4-4ccf-af90-c6ef33212f88" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.196055] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbd99ac4-1db4-4ccf-af90-c6ef33212f88" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.197143] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.198011] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.198011] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.198011] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.198011] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.198011] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbd99ac4-1db4-4ccf-af90-c6ef33212f88',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.556930] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock network-647 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.557193] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "network-647" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.557317] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "network-647" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.557586] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "network-647" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.557848] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.557997] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.558204] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.558362] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.558501] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.558695] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 611.558803] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 611.558932] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 611.559071] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 611.559181] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 611.559273] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 611.559402] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 611.578653] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 611.578801] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 611.578950] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 611.579150] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "network-647" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.579457] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock port-487797ea-c29a-47d2-a4b0-aee7cb5f451d taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.579606] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "port-487797ea-c29a-47d2-a4b0-aee7cb5f451d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.580149] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "port-487797ea-c29a-47d2-a4b0-aee7cb5f451d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.580149] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "port-487797ea-c29a-47d2-a4b0-aee7cb5f451d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.580262] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('487797ea-c29a-47d2-a4b0-aee7cb5f451d',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.585623] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 49f0917b-c43e-421e-9ccf-fe8487bf2b37: rpc.has_security_group_logging(os_id): False [ 611.607025] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.607025] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.607025] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.607025] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.607025] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.607025] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.607025] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.607025] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.607025] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.607025] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.607025] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.607025] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.607025] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.607025] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.607025] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.607715] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.607715] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.607715] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.607715] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.607715] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.607715] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49f0917b-c43e-421e-9ccf-fe8487bf2b37 is going to be created. [ 611.701073] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.701073] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.701073] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.701073] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.701073] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.701073] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.701561] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.701561] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.701561] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.701561] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.701561] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbd99ac4-1db4-4ccf-af90-c6ef33212f88 already deleted. [ 611.702361] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbd99ac4-1db4-4ccf-af90-c6ef33212f88" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.717830] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.717830] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.717830] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.717830] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.717830] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.740479] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49f0917b-c43e-421e-9ccf-fe8487bf2b37 in Status: IN_PROGRESS for 2s [ 612.086216] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.086216] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.086216] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.086580] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.086799] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.086896] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Segment Port 487797ea-c29a-47d2-a4b0-aee7cb5f451d not found, creating... [ 612.088136] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.088136] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.088136] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.088581] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.088724] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.089572] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.089572] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.089572] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.089794] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.090107] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.090259] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Resource: SegmentPort with ID: 487797ea-c29a-47d2-a4b0-aee7cb5f451d is going to be created. [ 612.115021] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.115021] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.115021] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.115021] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.115021] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.115021] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "port-487797ea-c29a-47d2-a4b0-aee7cb5f451d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.471625] env[65471]: INFO networking_nsxv3.common.synchronization [None req-4619e22f-ad3d-4c7a-98aa-0dac04290ed3 None None] Enqueued Resource ID: 507a71f2-480e-4246-89da-ea6d65f764da with Priority: HIGHEST for action port [ 612.472758] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 507a71f2-480e-4246-89da-ea6d65f764da with Priority: HIGHEST for action port [ 612.473156] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-507a71f2-480e-4246-89da-ea6d65f764da taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.473324] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-507a71f2-480e-4246-89da-ea6d65f764da" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.473398] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-507a71f2-480e-4246-89da-ea6d65f764da" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.473666] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-507a71f2-480e-4246-89da-ea6d65f764da" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.473750] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('507a71f2-480e-4246-89da-ea6d65f764da',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.509139] env[65471]: INFO networking_nsxv3.common.synchronization [req-582c3951-dcb6-429a-bd9d-6a4c963046cc req-99e2c967-f038-409c-87fc-826c48289565 tempest-ImagesOneServerTestJSON-1788246232 tempest-ImagesOneServerTestJSON-1788246232-project-member] Enqueued Resource ID: 50c2c28e-c8d2-4f9e-a431-6df336da2df5 with Priority: HIGHEST for action security_group_members [ 612.509733] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50c2c28e-c8d2-4f9e-a431-6df336da2df5 with Priority: HIGHEST for action security_group_members [ 612.510166] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-50c2c28e-c8d2-4f9e-a431-6df336da2df5 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.510369] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50c2c28e-c8d2-4f9e-a431-6df336da2df5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.510479] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50c2c28e-c8d2-4f9e-a431-6df336da2df5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.510773] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50c2c28e-c8d2-4f9e-a431-6df336da2df5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.511097] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.512901] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.513013] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.513202] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.513293] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.513395] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50c2c28e-c8d2-4f9e-a431-6df336da2df5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.837115] env[65471]: INFO networking_nsxv3.common.synchronization [req-414da022-07b4-46c4-9ef9-1d9681beacf3 req-f51e9553-6f76-4353-82d7-c9b1981f0be9 service nova] Enqueued Resource ID: bbd99ac4-1db4-4ccf-af90-c6ef33212f88 with Priority: HIGHEST for action security_group_rules [ 612.837318] env[65471]: INFO networking_nsxv3.common.synchronization [req-414da022-07b4-46c4-9ef9-1d9681beacf3 req-f51e9553-6f76-4353-82d7-c9b1981f0be9 service nova] Enqueued Resource ID: bbd99ac4-1db4-4ccf-af90-c6ef33212f88 with Priority: HIGHEST for action security_group_members [ 612.837406] env[65471]: INFO networking_nsxv3.common.synchronization [req-414da022-07b4-46c4-9ef9-1d9681beacf3 req-f51e9553-6f76-4353-82d7-c9b1981f0be9 service nova] Enqueued Resource ID: 487797ea-c29a-47d2-a4b0-aee7cb5f451d with Priority: HIGHEST for action port [ 612.839164] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbd99ac4-1db4-4ccf-af90-c6ef33212f88 with Priority: HIGHEST for action security_group_rules [ 612.839164] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbd99ac4-1db4-4ccf-af90-c6ef33212f88 with Priority: HIGHEST for action security_group_members [ 612.839164] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 487797ea-c29a-47d2-a4b0-aee7cb5f451d with Priority: HIGHEST for action port [ 612.839164] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bbd99ac4-1db4-4ccf-af90-c6ef33212f88 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.839164] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bbd99ac4-1db4-4ccf-af90-c6ef33212f88" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.839164] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bbd99ac4-1db4-4ccf-af90-c6ef33212f88" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.839164] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bbd99ac4-1db4-4ccf-af90-c6ef33212f88" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.839164] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bbd99ac4-1db4-4ccf-af90-c6ef33212f88',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.840313] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbd99ac4-1db4-4ccf-af90-c6ef33212f88 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.841100] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbd99ac4-1db4-4ccf-af90-c6ef33212f88" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.841100] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbd99ac4-1db4-4ccf-af90-c6ef33212f88" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.841100] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbd99ac4-1db4-4ccf-af90-c6ef33212f88" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.841325] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.842402] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.842402] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.842402] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.842402] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.842402] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbd99ac4-1db4-4ccf-af90-c6ef33212f88',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.843464] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-487797ea-c29a-47d2-a4b0-aee7cb5f451d taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.843802] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-487797ea-c29a-47d2-a4b0-aee7cb5f451d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.843802] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-487797ea-c29a-47d2-a4b0-aee7cb5f451d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.844281] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-487797ea-c29a-47d2-a4b0-aee7cb5f451d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.844365] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('487797ea-c29a-47d2-a4b0-aee7cb5f451d',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.976065] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 507a71f2-480e-4246-89da-ea6d65f764da [ 612.976320] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.976456] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.976535] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.976755] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.976868] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.976970] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:507a71f2-480e-4246-89da-ea6d65f764da already deleted. [ 612.977065] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-507a71f2-480e-4246-89da-ea6d65f764da" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.015249] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.016959] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.016959] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.016959] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.016959] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.016959] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.016959] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.016959] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.016959] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.016959] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.016959] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50c2c28e-c8d2-4f9e-a431-6df336da2df5 already deleted. [ 613.016959] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50c2c28e-c8d2-4f9e-a431-6df336da2df5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.041035] env[65471]: INFO networking_nsxv3.common.synchronization [None req-c6a0ea6e-9392-4e08-bd64-9367830d2587 None None] Enqueued Resource ID: 8fcc6638-af9b-481c-9504-2a36a8d1ae86 with Priority: HIGHEST for action port [ 613.041035] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fcc6638-af9b-481c-9504-2a36a8d1ae86 with Priority: HIGHEST for action port [ 613.041035] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-8fcc6638-af9b-481c-9504-2a36a8d1ae86 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.041035] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8fcc6638-af9b-481c-9504-2a36a8d1ae86" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.041035] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8fcc6638-af9b-481c-9504-2a36a8d1ae86" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.042783] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8fcc6638-af9b-481c-9504-2a36a8d1ae86" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.042964] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8fcc6638-af9b-481c-9504-2a36a8d1ae86',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.130133] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock network-568 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.130133] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "network-568" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.130133] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "network-568" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.130133] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "network-568" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.130133] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.130816] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.130816] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.132333] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.132333] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.132333] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 613.132333] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 613.132333] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 613.132333] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 613.132333] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 613.132333] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 613.133198] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 613.154186] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 613.154310] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 613.154442] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 613.154609] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "network-568" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.155227] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock port-9a1379ba-61e1-468c-be61-933eb453340e taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.155498] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "port-9a1379ba-61e1-468c-be61-933eb453340e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.155657] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "port-9a1379ba-61e1-468c-be61-933eb453340e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.156039] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "port-9a1379ba-61e1-468c-be61-933eb453340e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.156190] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a1379ba-61e1-468c-be61-933eb453340e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.341390] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbd99ac4-1db4-4ccf-af90-c6ef33212f88 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.341595] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbd99ac4-1db4-4ccf-af90-c6ef33212f88" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.344394] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bbd99ac4-1db4-4ccf-af90-c6ef33212f88',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.348537] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 487797ea-c29a-47d2-a4b0-aee7cb5f451d with status ACTIVE [ 613.348537] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.348537] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.348537] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.348537] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.348537] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.348537] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.348537] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.348537] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.348537] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.348537] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.348537] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.348537] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.349187] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.349187] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.349187] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.349187] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 487797ea-c29a-47d2-a4b0-aee7cb5f451d is going to be updated. [ 613.370187] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.370347] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.370398] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.370593] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.370726] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.370877] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-487797ea-c29a-47d2-a4b0-aee7cb5f451d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.545696] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8fcc6638-af9b-481c-9504-2a36a8d1ae86 [ 613.546091] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.546421] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.546565] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.546953] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.547041] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.547177] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8fcc6638-af9b-481c-9504-2a36a8d1ae86 already deleted. [ 613.547341] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8fcc6638-af9b-481c-9504-2a36a8d1ae86" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.659089] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.659336] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.659453] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.659734] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.659874] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.660064] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Segment Port 9a1379ba-61e1-468c-be61-933eb453340e not found, creating... [ 613.660371] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.660524] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.660634] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.660848] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.660973] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.661257] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.661401] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.661509] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.661702] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.661853] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.661962] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Resource: SegmentPort with ID: 9a1379ba-61e1-468c-be61-933eb453340e is going to be created. [ 613.682537] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.682821] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.682902] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.683164] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.683384] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.683961] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "port-9a1379ba-61e1-468c-be61-933eb453340e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.753251] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49f0917b-c43e-421e-9ccf-fe8487bf2b37 in Status: SUCCESS [ 613.753497] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49f0917b-c43e-421e-9ccf-fe8487bf2b37" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.846468] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bbd99ac4-1db4-4ccf-af90-c6ef33212f88',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.349572] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.350372] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.350372] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.350372] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.350372] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.350372] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbd99ac4-1db4-4ccf-af90-c6ef33212f88 is going to be created. [ 614.366345] env[65471]: INFO networking_nsxv3.common.synchronization [None req-87b52435-6308-40c3-bd53-d18b518fd1cb None None] Enqueued Resource ID: bb54b2f3-e7cc-465b-85de-8b4ce3445400 with Priority: HIGHEST for action port [ 614.366535] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb54b2f3-e7cc-465b-85de-8b4ce3445400 with Priority: HIGHEST for action port [ 614.366851] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-bb54b2f3-e7cc-465b-85de-8b4ce3445400 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.367069] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bb54b2f3-e7cc-465b-85de-8b4ce3445400" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.367154] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bb54b2f3-e7cc-465b-85de-8b4ce3445400" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.367479] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bb54b2f3-e7cc-465b-85de-8b4ce3445400" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.367564] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb54b2f3-e7cc-465b-85de-8b4ce3445400',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.378818] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.379116] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.379195] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.379796] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.379796] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.392604] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbd99ac4-1db4-4ccf-af90-c6ef33212f88 in Status: UNINITIALIZED for 2s [ 614.777102] env[65471]: INFO networking_nsxv3.common.synchronization [req-582c3951-dcb6-429a-bd9d-6a4c963046cc req-db60a6d8-ba12-4f2c-8b4c-cd0728c56b7e service nova] Enqueued Resource ID: 50c2c28e-c8d2-4f9e-a431-6df336da2df5 with Priority: HIGHEST for action security_group_rules [ 614.777774] env[65471]: INFO networking_nsxv3.common.synchronization [req-582c3951-dcb6-429a-bd9d-6a4c963046cc req-db60a6d8-ba12-4f2c-8b4c-cd0728c56b7e service nova] Enqueued Resource ID: 50c2c28e-c8d2-4f9e-a431-6df336da2df5 with Priority: HIGHEST for action security_group_members [ 614.777774] env[65471]: INFO networking_nsxv3.common.synchronization [req-582c3951-dcb6-429a-bd9d-6a4c963046cc req-db60a6d8-ba12-4f2c-8b4c-cd0728c56b7e service nova] Enqueued Resource ID: 9a1379ba-61e1-468c-be61-933eb453340e with Priority: HIGHEST for action port [ 614.777951] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50c2c28e-c8d2-4f9e-a431-6df336da2df5 with Priority: HIGHEST for action security_group_rules [ 614.778167] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50c2c28e-c8d2-4f9e-a431-6df336da2df5 with Priority: HIGHEST for action security_group_members [ 614.778252] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a1379ba-61e1-468c-be61-933eb453340e with Priority: HIGHEST for action port [ 614.778459] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-50c2c28e-c8d2-4f9e-a431-6df336da2df5 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.778588] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-50c2c28e-c8d2-4f9e-a431-6df336da2df5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.778662] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-50c2c28e-c8d2-4f9e-a431-6df336da2df5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.779380] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-50c2c28e-c8d2-4f9e-a431-6df336da2df5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.779380] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('50c2c28e-c8d2-4f9e-a431-6df336da2df5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.780043] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-50c2c28e-c8d2-4f9e-a431-6df336da2df5 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.780195] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50c2c28e-c8d2-4f9e-a431-6df336da2df5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.780409] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50c2c28e-c8d2-4f9e-a431-6df336da2df5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.780409] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50c2c28e-c8d2-4f9e-a431-6df336da2df5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.780765] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.780765] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.780765] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.782101] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.782101] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.782101] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50c2c28e-c8d2-4f9e-a431-6df336da2df5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.782101] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-9a1379ba-61e1-468c-be61-933eb453340e taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.782347] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9a1379ba-61e1-468c-be61-933eb453340e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.782347] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9a1379ba-61e1-468c-be61-933eb453340e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.785268] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9a1379ba-61e1-468c-be61-933eb453340e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.785268] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a1379ba-61e1-468c-be61-933eb453340e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.825082] env[65471]: INFO networking_nsxv3.common.synchronization [None req-e5ae42de-a7b4-4477-bec2-20a85b2de5d7 None None] Enqueued Resource ID: 1db6e775-4c40-44dc-b6db-707791d68c7f with Priority: HIGHEST for action port [ 614.825902] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1db6e775-4c40-44dc-b6db-707791d68c7f with Priority: HIGHEST for action port [ 614.828049] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-1db6e775-4c40-44dc-b6db-707791d68c7f taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.828531] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1db6e775-4c40-44dc-b6db-707791d68c7f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.828531] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1db6e775-4c40-44dc-b6db-707791d68c7f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.830194] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1db6e775-4c40-44dc-b6db-707791d68c7f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.830194] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1db6e775-4c40-44dc-b6db-707791d68c7f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.870122] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bb54b2f3-e7cc-465b-85de-8b4ce3445400 [ 614.870537] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.871793] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.872789] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.873868] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.874536] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.874746] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bb54b2f3-e7cc-465b-85de-8b4ce3445400 already deleted. [ 614.874873] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bb54b2f3-e7cc-465b-85de-8b4ce3445400" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.144831] env[65471]: INFO networking_nsxv3.common.synchronization [req-38ed997d-163e-4370-bcb1-3936f9bac83d req-c6819fce-6ba1-449f-bfd6-0c3d0848122f tempest-ImagesNegativeTestJSON-1441832217 tempest-ImagesNegativeTestJSON-1441832217-project-member] Enqueued Resource ID: 2701e2a3-bfcb-431d-b91c-91e91e5af6e1 with Priority: HIGHEST for action security_group_members [ 615.145403] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2701e2a3-bfcb-431d-b91c-91e91e5af6e1 with Priority: HIGHEST for action security_group_members [ 615.145711] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-2701e2a3-bfcb-431d-b91c-91e91e5af6e1 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.145838] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2701e2a3-bfcb-431d-b91c-91e91e5af6e1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.145950] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2701e2a3-bfcb-431d-b91c-91e91e5af6e1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.147832] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2701e2a3-bfcb-431d-b91c-91e91e5af6e1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.147832] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.147832] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.147832] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.147832] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.147832] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.147832] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2701e2a3-bfcb-431d-b91c-91e91e5af6e1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.284543] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-50c2c28e-c8d2-4f9e-a431-6df336da2df5 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.284543] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50c2c28e-c8d2-4f9e-a431-6df336da2df5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.284976] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('50c2c28e-c8d2-4f9e-a431-6df336da2df5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.287410] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9a1379ba-61e1-468c-be61-933eb453340e with status ACTIVE [ 615.288049] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.288049] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.288049] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.288242] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.288242] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.288486] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.289161] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.289161] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.289161] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.289161] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.289449] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.289604] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.289705] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.292986] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.292986] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.292986] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9a1379ba-61e1-468c-be61-933eb453340e is going to be updated. [ 615.329093] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.330353] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.330485] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.330724] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.330909] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.331170] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9a1379ba-61e1-468c-be61-933eb453340e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.331480] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1db6e775-4c40-44dc-b6db-707791d68c7f [ 615.332560] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.334907] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.334907] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.334907] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.334907] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.334907] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1db6e775-4c40-44dc-b6db-707791d68c7f already deleted. [ 615.334907] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1db6e775-4c40-44dc-b6db-707791d68c7f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.650967] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.650967] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.651400] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.651400] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.651675] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.651760] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.651859] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.651934] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.652164] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.652251] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.652358] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2701e2a3-bfcb-431d-b91c-91e91e5af6e1 already deleted. [ 615.652454] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2701e2a3-bfcb-431d-b91c-91e91e5af6e1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.788913] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('50c2c28e-c8d2-4f9e-a431-6df336da2df5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.889029] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock network-663 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.889029] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "network-663" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.889029] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "network-663" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.889029] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "network-663" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.889029] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.889029] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.889029] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.890132] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.890376] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.890679] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 615.890956] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 615.891170] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 615.893297] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 615.893297] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 615.893297] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 615.893297] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 615.913042] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 615.913172] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 615.913269] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 615.913436] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "network-663" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.913737] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock port-ab347e0f-722d-4bcf-a1e5-16a133f18105 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.913902] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "port-ab347e0f-722d-4bcf-a1e5-16a133f18105" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.914063] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "port-ab347e0f-722d-4bcf-a1e5-16a133f18105" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.915027] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "port-ab347e0f-722d-4bcf-a1e5-16a133f18105" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.915027] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab347e0f-722d-4bcf-a1e5-16a133f18105',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.293131] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.293358] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.293358] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.293563] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.293657] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.293753] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50c2c28e-c8d2-4f9e-a431-6df336da2df5 is going to be created. [ 616.320811] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.320959] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.321051] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.321285] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.321468] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.330781] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50c2c28e-c8d2-4f9e-a431-6df336da2df5 in Status: UNINITIALIZED for 2s [ 616.404370] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbd99ac4-1db4-4ccf-af90-c6ef33212f88 in Status: SUCCESS [ 616.404658] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbd99ac4-1db4-4ccf-af90-c6ef33212f88" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.404937] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbd99ac4-1db4-4ccf-af90-c6ef33212f88" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.405286] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbd99ac4-1db4-4ccf-af90-c6ef33212f88" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.405563] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.405735] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.405838] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.406095] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.406227] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.406365] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbd99ac4-1db4-4ccf-af90-c6ef33212f88" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.406507] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bbd99ac4-1db4-4ccf-af90-c6ef33212f88',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.417249] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.417683] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.417854] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.419019] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.419019] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.419019] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Segment Port ab347e0f-722d-4bcf-a1e5-16a133f18105 not found, creating... [ 616.419019] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.419019] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.419291] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.419291] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.419498] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.419805] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.420341] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.420341] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.420464] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.420495] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.420662] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Resource: SegmentPort with ID: ab347e0f-722d-4bcf-a1e5-16a133f18105 is going to be created. [ 616.440379] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.440628] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.440715] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.440982] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.441219] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.441447] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "port-ab347e0f-722d-4bcf-a1e5-16a133f18105" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.578054] env[65471]: INFO networking_nsxv3.common.synchronization [None req-47ad3aeb-9f46-4b07-ac3f-b41ce928c166 None None] Enqueued Resource ID: f3e7fc56-a447-41d6-a2c4-bac3ac2439a5 with Priority: HIGHEST for action port [ 616.578054] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3e7fc56-a447-41d6-a2c4-bac3ac2439a5 with Priority: HIGHEST for action port [ 616.578471] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-f3e7fc56-a447-41d6-a2c4-bac3ac2439a5 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.578634] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f3e7fc56-a447-41d6-a2c4-bac3ac2439a5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.578705] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f3e7fc56-a447-41d6-a2c4-bac3ac2439a5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.579035] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f3e7fc56-a447-41d6-a2c4-bac3ac2439a5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.579132] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3e7fc56-a447-41d6-a2c4-bac3ac2439a5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.914558] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbd99ac4-1db4-4ccf-af90-c6ef33212f88 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.915014] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbd99ac4-1db4-4ccf-af90-c6ef33212f88" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.915014] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbd99ac4-1db4-4ccf-af90-c6ef33212f88" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.915014] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbd99ac4-1db4-4ccf-af90-c6ef33212f88" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.915239] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.915330] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.915380] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.915498] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.915593] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.915660] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbd99ac4-1db4-4ccf-af90-c6ef33212f88" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.915804] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbd99ac4-1db4-4ccf-af90-c6ef33212f88 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.915899] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbd99ac4-1db4-4ccf-af90-c6ef33212f88" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.916019] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbd99ac4-1db4-4ccf-af90-c6ef33212f88" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.916153] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbd99ac4-1db4-4ccf-af90-c6ef33212f88" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.916293] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.916385] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.916440] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.916581] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.916677] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.916749] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbd99ac4-1db4-4ccf-af90-c6ef33212f88" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.916798] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bbd99ac4-1db4-4ccf-af90-c6ef33212f88',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.081224] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f3e7fc56-a447-41d6-a2c4-bac3ac2439a5 [ 617.081437] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.081533] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.081848] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.082155] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.082262] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.082328] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f3e7fc56-a447-41d6-a2c4-bac3ac2439a5 already deleted. [ 617.082653] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f3e7fc56-a447-41d6-a2c4-bac3ac2439a5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.166523] env[65471]: INFO networking_nsxv3.common.synchronization [req-38ed997d-163e-4370-bcb1-3936f9bac83d req-70388725-2a06-45c6-8e02-13e6d24b5234 service nova] Enqueued Resource ID: 2701e2a3-bfcb-431d-b91c-91e91e5af6e1 with Priority: HIGHEST for action security_group_rules [ 617.168046] env[65471]: INFO networking_nsxv3.common.synchronization [req-38ed997d-163e-4370-bcb1-3936f9bac83d req-70388725-2a06-45c6-8e02-13e6d24b5234 service nova] Enqueued Resource ID: 2701e2a3-bfcb-431d-b91c-91e91e5af6e1 with Priority: HIGHEST for action security_group_members [ 617.168046] env[65471]: INFO networking_nsxv3.common.synchronization [req-38ed997d-163e-4370-bcb1-3936f9bac83d req-70388725-2a06-45c6-8e02-13e6d24b5234 service nova] Enqueued Resource ID: ab347e0f-722d-4bcf-a1e5-16a133f18105 with Priority: HIGHEST for action port [ 617.168046] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2701e2a3-bfcb-431d-b91c-91e91e5af6e1 with Priority: HIGHEST for action security_group_rules [ 617.168046] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2701e2a3-bfcb-431d-b91c-91e91e5af6e1 with Priority: HIGHEST for action security_group_members [ 617.168046] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab347e0f-722d-4bcf-a1e5-16a133f18105 with Priority: HIGHEST for action port [ 617.168830] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2701e2a3-bfcb-431d-b91c-91e91e5af6e1 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.169128] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2701e2a3-bfcb-431d-b91c-91e91e5af6e1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.169297] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2701e2a3-bfcb-431d-b91c-91e91e5af6e1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.169641] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2701e2a3-bfcb-431d-b91c-91e91e5af6e1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.169819] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2701e2a3-bfcb-431d-b91c-91e91e5af6e1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.171122] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-2701e2a3-bfcb-431d-b91c-91e91e5af6e1 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.171504] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2701e2a3-bfcb-431d-b91c-91e91e5af6e1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.171660] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2701e2a3-bfcb-431d-b91c-91e91e5af6e1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.177022] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2701e2a3-bfcb-431d-b91c-91e91e5af6e1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.177022] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.177022] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.177022] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.177022] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.177022] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.177022] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2701e2a3-bfcb-431d-b91c-91e91e5af6e1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.179166] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-ab347e0f-722d-4bcf-a1e5-16a133f18105 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.179166] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ab347e0f-722d-4bcf-a1e5-16a133f18105" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.179166] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ab347e0f-722d-4bcf-a1e5-16a133f18105" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.179166] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ab347e0f-722d-4bcf-a1e5-16a133f18105" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.179166] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab347e0f-722d-4bcf-a1e5-16a133f18105',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.376083] env[65471]: INFO networking_nsxv3.common.synchronization [None req-66321b22-c93c-448a-b21e-8d9a62a100f0 None None] Enqueued Resource ID: 060e4c50-ccea-48bd-a513-c6b714fc62a4 with Priority: HIGHEST for action port [ 617.380744] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 060e4c50-ccea-48bd-a513-c6b714fc62a4 with Priority: HIGHEST for action port [ 617.381318] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-060e4c50-ccea-48bd-a513-c6b714fc62a4 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.381855] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-060e4c50-ccea-48bd-a513-c6b714fc62a4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.381855] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-060e4c50-ccea-48bd-a513-c6b714fc62a4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.382426] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-060e4c50-ccea-48bd-a513-c6b714fc62a4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.382567] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('060e4c50-ccea-48bd-a513-c6b714fc62a4',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.422431] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bbd99ac4-1db4-4ccf-af90-c6ef33212f88: rpc.has_security_group_logging(os_id): False [ 617.445241] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.445241] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.445241] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.445241] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.445241] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.445241] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.445241] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.445241] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.445241] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.445241] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.445241] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.445241] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.445241] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.445241] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.445241] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.445952] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.445952] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.445952] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.445952] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.446256] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.446442] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bbd99ac4-1db4-4ccf-af90-c6ef33212f88 is going to be created. [ 617.517060] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.517060] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.517060] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.517060] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.517060] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.526364] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bbd99ac4-1db4-4ccf-af90-c6ef33212f88 in Status: IN_PROGRESS for 2s [ 617.684021] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2701e2a3-bfcb-431d-b91c-91e91e5af6e1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.684021] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-2701e2a3-bfcb-431d-b91c-91e91e5af6e1 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.684021] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2701e2a3-bfcb-431d-b91c-91e91e5af6e1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.684021] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ab347e0f-722d-4bcf-a1e5-16a133f18105 with status ACTIVE [ 617.684021] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.684021] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.684021] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.684021] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.684021] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.684021] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.684021] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.684021] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.684021] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.684021] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.684695] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.684695] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.684695] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.684695] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.684695] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.684695] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ab347e0f-722d-4bcf-a1e5-16a133f18105 is going to be updated. [ 617.710775] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.710775] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.710775] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.710775] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.710775] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.710775] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ab347e0f-722d-4bcf-a1e5-16a133f18105" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.756148] env[65471]: INFO networking_nsxv3.common.synchronization [req-ccac0189-1703-4cee-a7e3-d6b32781f607 req-8f003384-dbf0-4809-b4d0-f9651244e240 tempest-ServerExternalEventsTest-1865778980 tempest-ServerExternalEventsTest-1865778980-project-member] Enqueued Resource ID: ceb1afc4-63ef-450a-b72c-5b79e8970a01 with Priority: HIGHEST for action security_group_members [ 617.757247] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ceb1afc4-63ef-450a-b72c-5b79e8970a01 with Priority: HIGHEST for action security_group_members [ 617.757920] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-ceb1afc4-63ef-450a-b72c-5b79e8970a01 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.758247] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ceb1afc4-63ef-450a-b72c-5b79e8970a01" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.758437] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ceb1afc4-63ef-450a-b72c-5b79e8970a01" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.758853] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ceb1afc4-63ef-450a-b72c-5b79e8970a01" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.759203] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.759486] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.759664] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.759995] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.760220] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.760426] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ceb1afc4-63ef-450a-b72c-5b79e8970a01',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.885590] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 060e4c50-ccea-48bd-a513-c6b714fc62a4 [ 617.886061] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.886992] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.886992] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.886992] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.886992] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.886992] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:060e4c50-ccea-48bd-a513-c6b714fc62a4 already deleted. [ 617.886992] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-060e4c50-ccea-48bd-a513-c6b714fc62a4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.189397] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2701e2a3-bfcb-431d-b91c-91e91e5af6e1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.262447] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.262689] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.262689] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.263288] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.263864] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.263864] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.263864] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.263864] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.265053] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.265053] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.265053] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ceb1afc4-63ef-450a-b72c-5b79e8970a01 already deleted. [ 618.265053] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ceb1afc4-63ef-450a-b72c-5b79e8970a01" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.343791] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50c2c28e-c8d2-4f9e-a431-6df336da2df5 in Status: SUCCESS [ 618.343791] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50c2c28e-c8d2-4f9e-a431-6df336da2df5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.343791] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50c2c28e-c8d2-4f9e-a431-6df336da2df5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.343969] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50c2c28e-c8d2-4f9e-a431-6df336da2df5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.344086] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.345257] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.345536] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.345536] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.345993] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.345993] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50c2c28e-c8d2-4f9e-a431-6df336da2df5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.345993] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('50c2c28e-c8d2-4f9e-a431-6df336da2df5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.374110] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock network-647 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.374110] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "network-647" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.374317] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "network-647" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.374536] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "network-647" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.374693] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.374860] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.375730] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.376025] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.376191] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.376399] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 618.376503] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 618.376603] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 618.376701] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 618.376798] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 618.376921] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 618.377077] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 618.400879] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 618.400879] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 618.400879] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 618.401304] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "network-647" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.401664] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock port-a216d317-0d37-4fc5-b574-2514d6b5d331 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.401905] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "port-a216d317-0d37-4fc5-b574-2514d6b5d331" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.401962] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "port-a216d317-0d37-4fc5-b574-2514d6b5d331" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.402610] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "port-a216d317-0d37-4fc5-b574-2514d6b5d331" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.402610] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a216d317-0d37-4fc5-b574-2514d6b5d331',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.693695] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.693866] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.693915] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.696241] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.696241] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.696241] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2701e2a3-bfcb-431d-b91c-91e91e5af6e1 is going to be created. [ 618.726642] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.728038] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.728038] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.728038] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.728038] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.738578] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2701e2a3-bfcb-431d-b91c-91e91e5af6e1 in Status: UNINITIALIZED for 2s [ 618.849265] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-50c2c28e-c8d2-4f9e-a431-6df336da2df5 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.849727] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50c2c28e-c8d2-4f9e-a431-6df336da2df5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.849727] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50c2c28e-c8d2-4f9e-a431-6df336da2df5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.849828] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50c2c28e-c8d2-4f9e-a431-6df336da2df5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.850507] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.850507] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.850507] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.850507] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.850507] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.850850] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50c2c28e-c8d2-4f9e-a431-6df336da2df5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.850850] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-50c2c28e-c8d2-4f9e-a431-6df336da2df5 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.850850] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50c2c28e-c8d2-4f9e-a431-6df336da2df5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.850850] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50c2c28e-c8d2-4f9e-a431-6df336da2df5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.851467] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50c2c28e-c8d2-4f9e-a431-6df336da2df5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.851467] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.851467] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.851467] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.851467] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.851730] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.851730] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50c2c28e-c8d2-4f9e-a431-6df336da2df5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.851730] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('50c2c28e-c8d2-4f9e-a431-6df336da2df5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.905841] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.906148] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.906207] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.906687] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.906687] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.906833] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Segment Port a216d317-0d37-4fc5-b574-2514d6b5d331 not found, creating... [ 618.907609] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.907889] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.908065] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.908499] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.908693] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.909080] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.909278] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.910268] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.910268] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.910268] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.911505] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Resource: SegmentPort with ID: a216d317-0d37-4fc5-b574-2514d6b5d331 is going to be created. [ 618.940040] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.940040] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.940040] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.940405] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.940444] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.941170] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "port-a216d317-0d37-4fc5-b574-2514d6b5d331" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.183099] env[65471]: INFO networking_nsxv3.common.synchronization [None req-c8ebeca8-f19e-40ce-bb3f-7de44a82fdf7 None None] Enqueued Resource ID: 197a2491-4ade-44d7-af76-af0082dc4507 with Priority: HIGHEST for action port [ 619.183712] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 197a2491-4ade-44d7-af76-af0082dc4507 with Priority: HIGHEST for action port [ 619.184097] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-197a2491-4ade-44d7-af76-af0082dc4507 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.184245] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-197a2491-4ade-44d7-af76-af0082dc4507" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.184326] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-197a2491-4ade-44d7-af76-af0082dc4507" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.184766] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-197a2491-4ade-44d7-af76-af0082dc4507" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.184766] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('197a2491-4ade-44d7-af76-af0082dc4507',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.353641] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 50c2c28e-c8d2-4f9e-a431-6df336da2df5: rpc.has_security_group_logging(os_id): False [ 619.372874] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.374168] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.374287] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.374552] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.374700] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.374979] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.375191] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.375191] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.375343] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.375417] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.375609] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.375733] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.375773] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.375918] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.375993] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.376353] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.376502] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.376502] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.376732] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.376830] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.377030] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 50c2c28e-c8d2-4f9e-a431-6df336da2df5 is going to be created. [ 619.449722] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.450268] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.450354] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.450606] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.450820] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.466362] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50c2c28e-c8d2-4f9e-a431-6df336da2df5 in Status: IN_PROGRESS for 2s [ 619.550851] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bbd99ac4-1db4-4ccf-af90-c6ef33212f88 in Status: SUCCESS [ 619.551112] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bbd99ac4-1db4-4ccf-af90-c6ef33212f88" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.593192] env[65471]: INFO networking_nsxv3.common.synchronization [req-6fc82062-32e6-4680-8308-6a674f807aa7 req-97e59260-052b-46e0-b763-690a82eb1f1c tempest-ServersAdminTestJSON-1197360877 tempest-ServersAdminTestJSON-1197360877-project-member] Enqueued Resource ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 with Priority: HIGHEST for action security_group_members [ 619.594043] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 with Priority: HIGHEST for action security_group_members [ 619.594538] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4ca8456-5b21-4080-b762-7b52a4837eb1 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.594538] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.594737] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.594991] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.595637] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.595637] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.595637] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.595790] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.595903] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.596100] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4ca8456-5b21-4080-b762-7b52a4837eb1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.690531] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 197a2491-4ade-44d7-af76-af0082dc4507 [ 619.690531] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.690531] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.690531] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.690531] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.690531] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.690531] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:197a2491-4ade-44d7-af76-af0082dc4507 already deleted. [ 619.690531] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-197a2491-4ade-44d7-af76-af0082dc4507" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.747908] env[65471]: INFO networking_nsxv3.common.synchronization [req-ccac0189-1703-4cee-a7e3-d6b32781f607 req-6d5b3b61-ad04-43c0-a65e-6dc8a0f9fd5f service nova] Enqueued Resource ID: ceb1afc4-63ef-450a-b72c-5b79e8970a01 with Priority: HIGHEST for action security_group_rules [ 619.747908] env[65471]: INFO networking_nsxv3.common.synchronization [req-ccac0189-1703-4cee-a7e3-d6b32781f607 req-6d5b3b61-ad04-43c0-a65e-6dc8a0f9fd5f service nova] Enqueued Resource ID: ceb1afc4-63ef-450a-b72c-5b79e8970a01 with Priority: HIGHEST for action security_group_members [ 619.747908] env[65471]: INFO networking_nsxv3.common.synchronization [req-ccac0189-1703-4cee-a7e3-d6b32781f607 req-6d5b3b61-ad04-43c0-a65e-6dc8a0f9fd5f service nova] Enqueued Resource ID: a216d317-0d37-4fc5-b574-2514d6b5d331 with Priority: HIGHEST for action port [ 619.748478] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ceb1afc4-63ef-450a-b72c-5b79e8970a01 with Priority: HIGHEST for action security_group_rules [ 619.752036] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ceb1afc4-63ef-450a-b72c-5b79e8970a01 with Priority: HIGHEST for action security_group_members [ 619.752036] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a216d317-0d37-4fc5-b574-2514d6b5d331 with Priority: HIGHEST for action port [ 619.752036] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ceb1afc4-63ef-450a-b72c-5b79e8970a01 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.752036] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ceb1afc4-63ef-450a-b72c-5b79e8970a01" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.752036] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ceb1afc4-63ef-450a-b72c-5b79e8970a01" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.752036] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ceb1afc4-63ef-450a-b72c-5b79e8970a01" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.752036] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ceb1afc4-63ef-450a-b72c-5b79e8970a01',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.752036] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-ceb1afc4-63ef-450a-b72c-5b79e8970a01 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.752036] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ceb1afc4-63ef-450a-b72c-5b79e8970a01" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.752036] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ceb1afc4-63ef-450a-b72c-5b79e8970a01" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.752036] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ceb1afc4-63ef-450a-b72c-5b79e8970a01" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.752036] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.752950] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.752950] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.752950] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.752950] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.752950] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ceb1afc4-63ef-450a-b72c-5b79e8970a01',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.753727] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-a216d317-0d37-4fc5-b574-2514d6b5d331 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.753872] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a216d317-0d37-4fc5-b574-2514d6b5d331" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.753964] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a216d317-0d37-4fc5-b574-2514d6b5d331" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.754176] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a216d317-0d37-4fc5-b574-2514d6b5d331" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.754288] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a216d317-0d37-4fc5-b574-2514d6b5d331',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.781587] env[65471]: INFO networking_nsxv3.common.synchronization [None req-0408c1e5-c24c-46f2-8fb0-b55a2a4e60cb None None] Enqueued Resource ID: 944e4824-3083-4e3a-aa22-207f2d3cb72f with Priority: HIGHEST for action port [ 619.783098] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 944e4824-3083-4e3a-aa22-207f2d3cb72f with Priority: HIGHEST for action port [ 619.783273] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-944e4824-3083-4e3a-aa22-207f2d3cb72f taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.783398] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-944e4824-3083-4e3a-aa22-207f2d3cb72f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.783466] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-944e4824-3083-4e3a-aa22-207f2d3cb72f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.783720] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-944e4824-3083-4e3a-aa22-207f2d3cb72f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.783805] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('944e4824-3083-4e3a-aa22-207f2d3cb72f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.099045] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.100706] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.100706] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.100706] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.100706] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.100706] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.100706] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.100706] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.100706] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.100706] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.100706] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 already deleted. [ 620.100706] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.171392] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock network-593 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.171914] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "network-593" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.171914] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "network-593" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.172117] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "network-593" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.172570] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.172726] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.172835] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.173088] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.173182] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.173386] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 620.173498] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 620.173664] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 620.173712] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 620.174360] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 620.174360] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 620.174360] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 620.195127] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 620.195325] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 620.195935] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 620.195935] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "network-593" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.196109] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock port-47889365-6c2f-464a-b36b-3db25538b76a taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.196198] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "port-47889365-6c2f-464a-b36b-3db25538b76a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.196380] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "port-47889365-6c2f-464a-b36b-3db25538b76a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.197117] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "port-47889365-6c2f-464a-b36b-3db25538b76a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.197117] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47889365-6c2f-464a-b36b-3db25538b76a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.255881] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-ceb1afc4-63ef-450a-b72c-5b79e8970a01 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.256119] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ceb1afc4-63ef-450a-b72c-5b79e8970a01" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.256193] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a216d317-0d37-4fc5-b574-2514d6b5d331 with status ACTIVE [ 620.256355] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.256463] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.256529] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.256744] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.256829] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.257138] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.257232] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.257296] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.257455] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.257533] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.257708] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.257800] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.257860] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.257998] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.258094] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.258168] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a216d317-0d37-4fc5-b574-2514d6b5d331 is going to be updated. [ 620.259367] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ceb1afc4-63ef-450a-b72c-5b79e8970a01',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.282759] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.283051] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.283051] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.283442] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.283611] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.283938] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a216d317-0d37-4fc5-b574-2514d6b5d331" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.286357] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 944e4824-3083-4e3a-aa22-207f2d3cb72f [ 620.286564] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.286692] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.286772] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.287120] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.287256] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.287415] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:944e4824-3083-4e3a-aa22-207f2d3cb72f already deleted. [ 620.287509] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-944e4824-3083-4e3a-aa22-207f2d3cb72f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.703048] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.703048] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.703048] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.703048] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.703048] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.703616] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Segment Port 47889365-6c2f-464a-b36b-3db25538b76a not found, creating... [ 620.703616] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.703616] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.703760] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.704084] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.704298] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.704711] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.704935] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.705510] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.706302] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.706302] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.706302] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Resource: SegmentPort with ID: 47889365-6c2f-464a-b36b-3db25538b76a is going to be created. [ 620.728713] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.728853] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.729156] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.729480] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.729712] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.729938] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "port-47889365-6c2f-464a-b36b-3db25538b76a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.751097] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2701e2a3-bfcb-431d-b91c-91e91e5af6e1 in Status: SUCCESS [ 620.751373] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2701e2a3-bfcb-431d-b91c-91e91e5af6e1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.751577] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2701e2a3-bfcb-431d-b91c-91e91e5af6e1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.751833] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2701e2a3-bfcb-431d-b91c-91e91e5af6e1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.752087] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.752231] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.752309] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.752497] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.752605] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.752702] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2701e2a3-bfcb-431d-b91c-91e91e5af6e1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.752840] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2701e2a3-bfcb-431d-b91c-91e91e5af6e1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.762467] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ceb1afc4-63ef-450a-b72c-5b79e8970a01',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.255142] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-2701e2a3-bfcb-431d-b91c-91e91e5af6e1 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.255347] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2701e2a3-bfcb-431d-b91c-91e91e5af6e1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.255440] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2701e2a3-bfcb-431d-b91c-91e91e5af6e1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.255707] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2701e2a3-bfcb-431d-b91c-91e91e5af6e1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.258214] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.258214] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.258214] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.258214] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.258214] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.258214] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2701e2a3-bfcb-431d-b91c-91e91e5af6e1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.258214] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-2701e2a3-bfcb-431d-b91c-91e91e5af6e1 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.258214] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2701e2a3-bfcb-431d-b91c-91e91e5af6e1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.258214] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2701e2a3-bfcb-431d-b91c-91e91e5af6e1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.258214] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2701e2a3-bfcb-431d-b91c-91e91e5af6e1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.258214] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.258214] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.258214] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.258214] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.258214] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.258214] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2701e2a3-bfcb-431d-b91c-91e91e5af6e1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.258214] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2701e2a3-bfcb-431d-b91c-91e91e5af6e1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.267806] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.267806] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.267806] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.267806] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.267806] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.267806] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ceb1afc4-63ef-450a-b72c-5b79e8970a01 is going to be created. [ 621.293937] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.294102] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.294183] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.294381] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.294538] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.310462] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ceb1afc4-63ef-450a-b72c-5b79e8970a01 in Status: UNINITIALIZED for 2s [ 621.411317] env[65471]: INFO networking_nsxv3.common.synchronization [None req-311022f2-dc70-405b-8fcf-e660b450b6df None None] Enqueued Resource ID: 77dfbda3-c74e-45b8-8d70-cea10ff96dcc with Priority: HIGHEST for action port [ 621.411317] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77dfbda3-c74e-45b8-8d70-cea10ff96dcc with Priority: HIGHEST for action port [ 621.412699] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-77dfbda3-c74e-45b8-8d70-cea10ff96dcc taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.413366] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77dfbda3-c74e-45b8-8d70-cea10ff96dcc" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.413747] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77dfbda3-c74e-45b8-8d70-cea10ff96dcc" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.414163] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77dfbda3-c74e-45b8-8d70-cea10ff96dcc" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.414401] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77dfbda3-c74e-45b8-8d70-cea10ff96dcc',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.472453] env[65471]: INFO networking_nsxv3.common.synchronization [req-6fc82062-32e6-4680-8308-6a674f807aa7 req-cbe57ebf-511e-4da1-8f80-4f8bf93b91cb service nova] Enqueued Resource ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 with Priority: HIGHEST for action security_group_rules [ 621.472589] env[65471]: INFO networking_nsxv3.common.synchronization [req-6fc82062-32e6-4680-8308-6a674f807aa7 req-cbe57ebf-511e-4da1-8f80-4f8bf93b91cb service nova] Enqueued Resource ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 with Priority: HIGHEST for action security_group_members [ 621.472727] env[65471]: INFO networking_nsxv3.common.synchronization [req-6fc82062-32e6-4680-8308-6a674f807aa7 req-cbe57ebf-511e-4da1-8f80-4f8bf93b91cb service nova] Enqueued Resource ID: 47889365-6c2f-464a-b36b-3db25538b76a with Priority: HIGHEST for action port [ 621.472951] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 with Priority: HIGHEST for action security_group_rules [ 621.473094] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 with Priority: HIGHEST for action security_group_members [ 621.473189] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47889365-6c2f-464a-b36b-3db25538b76a with Priority: HIGHEST for action port [ 621.473739] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e4ca8456-5b21-4080-b762-7b52a4837eb1 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.473867] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.473934] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.474681] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.474814] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e4ca8456-5b21-4080-b762-7b52a4837eb1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.476067] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4ca8456-5b21-4080-b762-7b52a4837eb1 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.476500] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.476500] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.476500] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.476749] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.477462] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.477562] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.477874] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.477971] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.478130] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4ca8456-5b21-4080-b762-7b52a4837eb1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.480539] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-47889365-6c2f-464a-b36b-3db25538b76a taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.480539] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-47889365-6c2f-464a-b36b-3db25538b76a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.480539] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-47889365-6c2f-464a-b36b-3db25538b76a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.480539] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-47889365-6c2f-464a-b36b-3db25538b76a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.480539] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47889365-6c2f-464a-b36b-3db25538b76a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.482793] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50c2c28e-c8d2-4f9e-a431-6df336da2df5 in Status: SUCCESS [ 621.483051] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-50c2c28e-c8d2-4f9e-a431-6df336da2df5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.761953] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2701e2a3-bfcb-431d-b91c-91e91e5af6e1: rpc.has_security_group_logging(os_id): False [ 621.795287] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.795493] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.795632] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.795778] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.795882] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.796174] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.796288] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.796349] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.796576] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.796647] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.796865] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.797029] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.797149] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.797271] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.797343] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.797556] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.797656] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.797733] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.797919] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.798067] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.798169] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2701e2a3-bfcb-431d-b91c-91e91e5af6e1 is going to be created. [ 621.888153] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.888462] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.888554] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.888959] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.889343] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.905344] env[65471]: INFO networking_nsxv3.common.synchronization [req-b321f154-18d0-4858-87e3-4d5b9dbbfe5a req-90e5cb79-01cb-4479-a9b9-65f162d40748 tempest-SecurityGroupRulesNegativeTestJSON-1201449079 tempest-SecurityGroupRulesNegativeTestJSON-1201449079-project-member] Enqueued Resource ID: 829f39c6-400b-4750-b6ec-802cba0d62be with Priority: HIGHEST for action security_group_rules [ 621.906760] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2701e2a3-bfcb-431d-b91c-91e91e5af6e1 in Status: IN_PROGRESS for 2s [ 621.907372] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 829f39c6-400b-4750-b6ec-802cba0d62be with Priority: HIGHEST for action security_group_rules [ 621.907718] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-829f39c6-400b-4750-b6ec-802cba0d62be taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.907841] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-829f39c6-400b-4750-b6ec-802cba0d62be" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.907921] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-829f39c6-400b-4750-b6ec-802cba0d62be" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.908150] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-829f39c6-400b-4750-b6ec-802cba0d62be" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.908248] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('829f39c6-400b-4750-b6ec-802cba0d62be',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.916642] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 77dfbda3-c74e-45b8-8d70-cea10ff96dcc [ 621.916862] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.917015] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.917092] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.917303] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.917412] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.917513] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:77dfbda3-c74e-45b8-8d70-cea10ff96dcc already deleted. [ 621.917598] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77dfbda3-c74e-45b8-8d70-cea10ff96dcc" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.982493] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4ca8456-5b21-4080-b762-7b52a4837eb1 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.982493] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.983181] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e4ca8456-5b21-4080-b762-7b52a4837eb1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.985155] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 47889365-6c2f-464a-b36b-3db25538b76a with status ACTIVE [ 621.985155] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.985307] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.985307] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.985501] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.985591] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.985775] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.985869] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.985930] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.986092] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.986169] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.986347] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.986439] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.986538] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.986628] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.986702] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.986783] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 47889365-6c2f-464a-b36b-3db25538b76a is going to be updated. [ 622.020725] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.020892] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.020892] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.021041] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.021187] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.021349] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-47889365-6c2f-464a-b36b-3db25538b76a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.436354] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.436633] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.436824] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.437127] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.437252] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.437440] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 829f39c6-400b-4750-b6ec-802cba0d62be already deleted. [ 622.437543] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-829f39c6-400b-4750-b6ec-802cba0d62be" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.489377] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e4ca8456-5b21-4080-b762-7b52a4837eb1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.624481] env[65471]: INFO networking_nsxv3.common.synchronization [req-e8db02c5-d50a-4ee7-b93f-444414426ce3 req-2358d320-74dd-4465-96d9-976b97fe1f0b tempest-ServerActionsTestJSON-1061383532 tempest-ServerActionsTestJSON-1061383532-project-member] Enqueued Resource ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 with Priority: HIGHEST for action security_group_members [ 622.625438] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 with Priority: HIGHEST for action security_group_members [ 622.625775] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-401f7079-c4c2-4951-b6ae-bc1cfbb23228 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.625891] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.625956] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.626391] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.626697] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.626790] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.626830] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.626999] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.627111] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.627205] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('401f7079-c4c2-4951-b6ae-bc1cfbb23228',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.991731] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.992038] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.992038] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.992290] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.992379] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.992472] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 is going to be created. [ 623.018858] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.019042] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.019141] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.019353] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.020326] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.030671] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 in Status: UNINITIALIZED for 2s [ 623.117079] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock network-487 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.117278] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "network-487" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.117359] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "network-487" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.117689] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "network-487" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.117962] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.118145] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.118258] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.118479] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.118622] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.118805] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 623.118985] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 623.119048] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 623.119183] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 623.119293] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 623.119396] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 623.119523] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 623.129929] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.130096] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.130194] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.130472] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.130566] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.130790] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.130875] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.130913] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.131088] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.131166] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.131254] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 already deleted. [ 623.131363] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.140498] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 623.140587] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 623.140743] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 623.140861] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "network-487" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.141160] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock port-3c3954f7-4015-4c85-a4bb-b28a13ab620f taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.141367] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "port-3c3954f7-4015-4c85-a4bb-b28a13ab620f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.141431] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "port-3c3954f7-4015-4c85-a4bb-b28a13ab620f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.141816] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "port-3c3954f7-4015-4c85-a4bb-b28a13ab620f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.142016] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c3954f7-4015-4c85-a4bb-b28a13ab620f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.321072] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ceb1afc4-63ef-450a-b72c-5b79e8970a01 in Status: SUCCESS [ 623.321376] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ceb1afc4-63ef-450a-b72c-5b79e8970a01" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.321612] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ceb1afc4-63ef-450a-b72c-5b79e8970a01" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.321874] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ceb1afc4-63ef-450a-b72c-5b79e8970a01" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.322104] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.322236] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.322304] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.322485] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.322582] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.322671] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ceb1afc4-63ef-450a-b72c-5b79e8970a01" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.322765] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ceb1afc4-63ef-450a-b72c-5b79e8970a01',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.466273] env[65471]: INFO networking_nsxv3.common.synchronization [None req-e89922c9-b6ea-4e3e-9e79-8fa32130703c None None] Enqueued Resource ID: e8f6bd55-f6e4-4e61-b32b-04e08b592ae9 with Priority: HIGHEST for action port [ 623.466907] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8f6bd55-f6e4-4e61-b32b-04e08b592ae9 with Priority: HIGHEST for action port [ 623.467254] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-e8f6bd55-f6e4-4e61-b32b-04e08b592ae9 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.467373] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e8f6bd55-f6e4-4e61-b32b-04e08b592ae9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.467433] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e8f6bd55-f6e4-4e61-b32b-04e08b592ae9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.467692] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e8f6bd55-f6e4-4e61-b32b-04e08b592ae9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.467776] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e8f6bd55-f6e4-4e61-b32b-04e08b592ae9',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.644333] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.644526] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.644665] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.644954] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.645263] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.645263] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Segment Port 3c3954f7-4015-4c85-a4bb-b28a13ab620f not found, creating... [ 623.645559] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.645764] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.645890] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.646201] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.646436] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.647285] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.647509] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.647627] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.647884] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.648046] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.648191] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Resource: SegmentPort with ID: 3c3954f7-4015-4c85-a4bb-b28a13ab620f is going to be created. [ 623.671820] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.672071] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.672195] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.672490] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.672716] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.672942] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "port-3c3954f7-4015-4c85-a4bb-b28a13ab620f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.827458] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-ceb1afc4-63ef-450a-b72c-5b79e8970a01 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.827640] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ceb1afc4-63ef-450a-b72c-5b79e8970a01" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.827690] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ceb1afc4-63ef-450a-b72c-5b79e8970a01" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.827934] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ceb1afc4-63ef-450a-b72c-5b79e8970a01" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.828144] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.828265] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.828327] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.828763] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.828763] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.828763] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ceb1afc4-63ef-450a-b72c-5b79e8970a01" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.828882] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-ceb1afc4-63ef-450a-b72c-5b79e8970a01 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.828882] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ceb1afc4-63ef-450a-b72c-5b79e8970a01" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.829056] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ceb1afc4-63ef-450a-b72c-5b79e8970a01" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.829213] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ceb1afc4-63ef-450a-b72c-5b79e8970a01" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.829364] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.830936] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.830936] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.830936] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.830936] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.830936] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ceb1afc4-63ef-450a-b72c-5b79e8970a01" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.830936] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ceb1afc4-63ef-450a-b72c-5b79e8970a01',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.922936] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2701e2a3-bfcb-431d-b91c-91e91e5af6e1 in Status: SUCCESS [ 623.922936] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2701e2a3-bfcb-431d-b91c-91e91e5af6e1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.970836] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e8f6bd55-f6e4-4e61-b32b-04e08b592ae9 [ 623.971139] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.971375] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.971375] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.971489] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.971614] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.971680] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e8f6bd55-f6e4-4e61-b32b-04e08b592ae9 already deleted. [ 623.971753] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e8f6bd55-f6e4-4e61-b32b-04e08b592ae9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.332735] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ceb1afc4-63ef-450a-b72c-5b79e8970a01: rpc.has_security_group_logging(os_id): False [ 624.351901] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.352280] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.352280] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.352419] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.352419] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.352733] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.352733] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.352850] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.353232] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.353232] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.353232] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.353355] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.353355] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.353428] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.353500] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.353700] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.353789] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.353846] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.353980] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.356802] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.356889] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ceb1afc4-63ef-450a-b72c-5b79e8970a01 is going to be created. [ 624.419228] env[65471]: INFO networking_nsxv3.common.synchronization [req-e8db02c5-d50a-4ee7-b93f-444414426ce3 req-acbb4b5d-3a1b-4eb2-ad70-34aef2c68685 service nova] Enqueued Resource ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 with Priority: HIGHEST for action security_group_rules [ 624.419228] env[65471]: INFO networking_nsxv3.common.synchronization [req-e8db02c5-d50a-4ee7-b93f-444414426ce3 req-acbb4b5d-3a1b-4eb2-ad70-34aef2c68685 service nova] Enqueued Resource ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 with Priority: HIGHEST for action security_group_members [ 624.419401] env[65471]: INFO networking_nsxv3.common.synchronization [req-e8db02c5-d50a-4ee7-b93f-444414426ce3 req-acbb4b5d-3a1b-4eb2-ad70-34aef2c68685 service nova] Enqueued Resource ID: 3c3954f7-4015-4c85-a4bb-b28a13ab620f with Priority: HIGHEST for action port [ 624.422768] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.422892] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.422948] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.423188] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.423371] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.425795] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 with Priority: HIGHEST for action security_group_rules [ 624.426066] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 with Priority: HIGHEST for action security_group_members [ 624.426066] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c3954f7-4015-4c85-a4bb-b28a13ab620f with Priority: HIGHEST for action port [ 624.426368] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-401f7079-c4c2-4951-b6ae-bc1cfbb23228 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.426840] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.426918] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.427151] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.427232] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('401f7079-c4c2-4951-b6ae-bc1cfbb23228',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.430466] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-401f7079-c4c2-4951-b6ae-bc1cfbb23228 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.431160] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.431160] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.431308] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.433300] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.433717] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.433717] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.433892] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.434046] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.434196] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('401f7079-c4c2-4951-b6ae-bc1cfbb23228',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.438816] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-3c3954f7-4015-4c85-a4bb-b28a13ab620f taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.438816] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3c3954f7-4015-4c85-a4bb-b28a13ab620f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.438816] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3c3954f7-4015-4c85-a4bb-b28a13ab620f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.438816] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3c3954f7-4015-4c85-a4bb-b28a13ab620f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.438816] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c3954f7-4015-4c85-a4bb-b28a13ab620f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.449864] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ceb1afc4-63ef-450a-b72c-5b79e8970a01 in Status: IN_PROGRESS for 2s [ 624.801562] env[65471]: INFO networking_nsxv3.common.synchronization [req-ae0dfb00-e761-4f8d-a378-5367aa77336c req-a19dc9e0-efe7-4a90-aaa7-55058c6523e4 tempest-ServersAdminTestJSON-1197360877 tempest-ServersAdminTestJSON-1197360877-project-member] Enqueued Resource ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 with Priority: HIGHEST for action security_group_members [ 624.802671] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 with Priority: HIGHEST for action security_group_members [ 624.803162] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4ca8456-5b21-4080-b762-7b52a4837eb1 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.803711] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.937771] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('401f7079-c4c2-4951-b6ae-bc1cfbb23228',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.939664] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3c3954f7-4015-4c85-a4bb-b28a13ab620f with status ACTIVE [ 624.939778] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.939938] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.940069] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.941859] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.941859] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.941859] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.941859] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.941859] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.941859] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.941859] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.941859] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.941859] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.941859] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.941859] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.941859] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.943136] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3c3954f7-4015-4c85-a4bb-b28a13ab620f is going to be updated. [ 624.944516] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-401f7079-c4c2-4951-b6ae-bc1cfbb23228 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.944660] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.967801] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.968448] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.968448] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.968448] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.968689] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.968948] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3c3954f7-4015-4c85-a4bb-b28a13ab620f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.048027] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 in Status: SUCCESS [ 625.048027] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.048027] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.048027] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.048027] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.048027] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.048027] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.048027] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.048027] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.048027] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.048027] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e4ca8456-5b21-4080-b762-7b52a4837eb1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.049400] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.049882] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.050241] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.050538] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.050733] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.051087] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.051423] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.051638] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4ca8456-5b21-4080-b762-7b52a4837eb1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.317787] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock network-593 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.318011] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "network-593" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.318156] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "network-593" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.318420] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "network-593" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.318837] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.318837] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.318980] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.319288] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.319413] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.319808] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 625.319918] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 625.320269] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 625.320269] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 625.320269] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 625.320410] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 625.320500] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 625.331318] env[65471]: INFO networking_nsxv3.common.synchronization [None req-0dff3238-1a9a-4b31-ab68-bd24f5b20a16 None None] Enqueued Resource ID: 860871f2-93f5-4846-a81e-f3e1edbafc7b with Priority: HIGHEST for action port [ 625.331893] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 860871f2-93f5-4846-a81e-f3e1edbafc7b with Priority: HIGHEST for action port [ 625.333181] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-860871f2-93f5-4846-a81e-f3e1edbafc7b taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.333610] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-860871f2-93f5-4846-a81e-f3e1edbafc7b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.334195] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-860871f2-93f5-4846-a81e-f3e1edbafc7b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.334488] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-860871f2-93f5-4846-a81e-f3e1edbafc7b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.334577] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('860871f2-93f5-4846-a81e-f3e1edbafc7b',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.346360] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 625.346540] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 625.346681] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 625.346851] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "network-593" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.347420] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock port-31172a85-b02a-40ae-b001-2ddbadade715 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.347625] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "port-31172a85-b02a-40ae-b001-2ddbadade715" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.347758] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "port-31172a85-b02a-40ae-b001-2ddbadade715" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.348650] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "port-31172a85-b02a-40ae-b001-2ddbadade715" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.348916] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31172a85-b02a-40ae-b001-2ddbadade715',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.439984] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('401f7079-c4c2-4951-b6ae-bc1cfbb23228',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.554525] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4ca8456-5b21-4080-b762-7b52a4837eb1 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.554818] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.554939] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e4ca8456-5b21-4080-b762-7b52a4837eb1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.838736] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 860871f2-93f5-4846-a81e-f3e1edbafc7b [ 625.839136] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.839356] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.839460] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.839719] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.839803] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.839926] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:860871f2-93f5-4846-a81e-f3e1edbafc7b already deleted. [ 625.840032] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-860871f2-93f5-4846-a81e-f3e1edbafc7b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.851751] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.852051] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.852287] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.852531] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.852718] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.852910] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Segment Port 31172a85-b02a-40ae-b001-2ddbadade715 not found, creating... [ 625.853243] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.853452] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.853591] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.853881] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.854066] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.854392] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.854764] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.854954] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.855191] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.855359] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.855560] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Resource: SegmentPort with ID: 31172a85-b02a-40ae-b001-2ddbadade715 is going to be created. [ 625.882786] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.883100] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.883264] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.883776] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.884836] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.885014] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "port-31172a85-b02a-40ae-b001-2ddbadade715" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.944201] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.944359] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.944419] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.944628] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.944716] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.944812] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 is going to be created. [ 625.978536] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.978536] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.978536] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.978536] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.978536] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.015470] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 in Status: UNINITIALIZED for 2s [ 626.059546] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e4ca8456-5b21-4080-b762-7b52a4837eb1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.465025] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ceb1afc4-63ef-450a-b72c-5b79e8970a01 in Status: SUCCESS [ 626.465025] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ceb1afc4-63ef-450a-b72c-5b79e8970a01" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.564226] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.564226] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.564226] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.565272] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.565272] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.565272] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 is going to be updated. [ 626.609320] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.609440] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.609482] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.611658] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.611658] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.619568] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 in Status: IN_PROGRESS for 2s [ 626.671780] env[65471]: INFO networking_nsxv3.common.synchronization [req-ae0dfb00-e761-4f8d-a378-5367aa77336c req-f82c522a-2cdf-49d0-96bc-509a77060259 service nova] Enqueued Resource ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 with Priority: HIGHEST for action security_group_rules [ 626.671973] env[65471]: INFO networking_nsxv3.common.synchronization [req-ae0dfb00-e761-4f8d-a378-5367aa77336c req-f82c522a-2cdf-49d0-96bc-509a77060259 service nova] Enqueued Resource ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 with Priority: HIGHEST for action security_group_members [ 626.672239] env[65471]: INFO networking_nsxv3.common.synchronization [req-ae0dfb00-e761-4f8d-a378-5367aa77336c req-f82c522a-2cdf-49d0-96bc-509a77060259 service nova] Enqueued Resource ID: 31172a85-b02a-40ae-b001-2ddbadade715 with Priority: HIGHEST for action port [ 626.672711] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 with Priority: HIGHEST for action security_group_rules [ 626.672840] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 with Priority: HIGHEST for action security_group_members [ 626.672938] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31172a85-b02a-40ae-b001-2ddbadade715 with Priority: HIGHEST for action port [ 626.673229] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e4ca8456-5b21-4080-b762-7b52a4837eb1 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.673379] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.673602] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4ca8456-5b21-4080-b762-7b52a4837eb1 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.673708] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.673881] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-31172a85-b02a-40ae-b001-2ddbadade715 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.673982] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31172a85-b02a-40ae-b001-2ddbadade715" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.674050] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31172a85-b02a-40ae-b001-2ddbadade715" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.674285] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31172a85-b02a-40ae-b001-2ddbadade715" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.674368] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31172a85-b02a-40ae-b001-2ddbadade715',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.177035] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 31172a85-b02a-40ae-b001-2ddbadade715 with status ACTIVE [ 627.177035] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.177035] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.177035] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.177345] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.177345] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.177454] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.177922] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.177922] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.177922] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.177922] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.178186] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.178186] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.178186] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.178323] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.178356] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.178449] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 31172a85-b02a-40ae-b001-2ddbadade715 is going to be updated. [ 627.204491] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.204717] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.204773] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.205059] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.205473] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.205546] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31172a85-b02a-40ae-b001-2ddbadade715" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.601104] env[65471]: INFO networking_nsxv3.common.synchronization [req-81a34023-3fa4-4dc9-92c2-cb52a22e6e3c req-cd40e449-57ea-41d1-aa83-3aded692f2f9 tempest-VolumesAssistedSnapshotsTest-1042800714 tempest-VolumesAssistedSnapshotsTest-1042800714-project-member] Enqueued Resource ID: aa46e0ea-568f-4c50-a725-6d162fee238a with Priority: HIGHEST for action security_group_members [ 627.601664] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa46e0ea-568f-4c50-a725-6d162fee238a with Priority: HIGHEST for action security_group_members [ 627.601971] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa46e0ea-568f-4c50-a725-6d162fee238a taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.602135] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa46e0ea-568f-4c50-a725-6d162fee238a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.602215] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa46e0ea-568f-4c50-a725-6d162fee238a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.602463] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa46e0ea-568f-4c50-a725-6d162fee238a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.602733] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.602733] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.602903] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.602903] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.602998] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.603077] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa46e0ea-568f-4c50-a725-6d162fee238a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.943476] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock network-459 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.943581] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "network-459" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.943660] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "network-459" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.944065] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "network-459" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.944335] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.944489] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.944597] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.944811] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.944946] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.945158] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 627.945258] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 627.945357] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 627.945458] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 627.945609] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 627.945658] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 627.945771] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 627.964486] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 627.964661] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 627.964835] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 627.965294] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "network-459" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.965294] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock port-f5cc64a0-c79d-4164-93d9-09f30eed037a taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.965566] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "port-f5cc64a0-c79d-4164-93d9-09f30eed037a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.965607] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "port-f5cc64a0-c79d-4164-93d9-09f30eed037a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.965920] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "port-f5cc64a0-c79d-4164-93d9-09f30eed037a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.966066] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5cc64a0-c79d-4164-93d9-09f30eed037a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.026277] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 in Status: SUCCESS [ 628.027749] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.028217] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.028339] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.028520] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.028642] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.028707] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.028935] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.028935] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.029056] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.029258] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('401f7079-c4c2-4951-b6ae-bc1cfbb23228',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.105375] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.105547] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.105597] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.105809] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.105900] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.106149] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.106252] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.106292] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.106438] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.106514] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.106599] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa46e0ea-568f-4c50-a725-6d162fee238a already deleted. [ 628.106679] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa46e0ea-568f-4c50-a725-6d162fee238a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.470436] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.470436] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.470436] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.470436] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.470436] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.470436] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Segment Port f5cc64a0-c79d-4164-93d9-09f30eed037a not found, creating... [ 628.470436] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.470436] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.470436] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.470926] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.470926] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.471070] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.471231] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.472055] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.472055] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.472055] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.472055] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Resource: SegmentPort with ID: f5cc64a0-c79d-4164-93d9-09f30eed037a is going to be created. [ 628.494087] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.494344] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.494498] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.494709] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.494932] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.495862] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "port-f5cc64a0-c79d-4164-93d9-09f30eed037a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.531562] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('401f7079-c4c2-4951-b6ae-bc1cfbb23228',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.631253] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 in Status: SUCCESS [ 628.631733] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.631930] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.632220] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.632447] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.632607] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.632691] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.632839] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.632986] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.633078] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.633261] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4ca8456-5b21-4080-b762-7b52a4837eb1 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.633379] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.633379] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.633560] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.633750] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.633900] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.634022] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.634216] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.634298] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.634381] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.634469] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e4ca8456-5b21-4080-b762-7b52a4837eb1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.635804] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.635970] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.636148] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.636264] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.636338] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.636447] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.636524] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.636612] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4ca8456-5b21-4080-b762-7b52a4837eb1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.034215] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 401f7079-c4c2-4951-b6ae-bc1cfbb23228: rpc.has_security_group_logging(os_id): False [ 629.060779] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.060779] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.060779] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.060779] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.060779] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.060779] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.060779] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.060779] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.060779] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.060779] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.060779] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 is going to be created. [ 629.141104] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e4ca8456-5b21-4080-b762-7b52a4837eb1: rpc.has_security_group_logging(os_id): False [ 629.143454] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e4ca8456-5b21-4080-b762-7b52a4837eb1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.146674] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.146849] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.147332] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.147332] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.147559] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.167849] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 in Status: IN_PROGRESS for 2s [ 629.172651] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.172876] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.172944] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.173217] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.173309] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.173595] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.173793] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.173793] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.173987] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.174109] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.174714] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.174714] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.174961] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.174961] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.175045] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.175255] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.175362] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.175425] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.175574] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.175646] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.175739] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 is going to be created. [ 629.256942] env[65471]: INFO networking_nsxv3.common.synchronization [req-81a34023-3fa4-4dc9-92c2-cb52a22e6e3c req-08a3ce83-500f-408a-aee5-92e9800dcf8b service nova] Enqueued Resource ID: aa46e0ea-568f-4c50-a725-6d162fee238a with Priority: HIGHEST for action security_group_rules [ 629.262519] env[65471]: INFO networking_nsxv3.common.synchronization [req-81a34023-3fa4-4dc9-92c2-cb52a22e6e3c req-08a3ce83-500f-408a-aee5-92e9800dcf8b service nova] Enqueued Resource ID: aa46e0ea-568f-4c50-a725-6d162fee238a with Priority: HIGHEST for action security_group_members [ 629.262923] env[65471]: INFO networking_nsxv3.common.synchronization [req-81a34023-3fa4-4dc9-92c2-cb52a22e6e3c req-08a3ce83-500f-408a-aee5-92e9800dcf8b service nova] Enqueued Resource ID: f5cc64a0-c79d-4164-93d9-09f30eed037a with Priority: HIGHEST for action port [ 629.263886] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa46e0ea-568f-4c50-a725-6d162fee238a with Priority: HIGHEST for action security_group_rules [ 629.264113] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa46e0ea-568f-4c50-a725-6d162fee238a with Priority: HIGHEST for action security_group_members [ 629.264265] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5cc64a0-c79d-4164-93d9-09f30eed037a with Priority: HIGHEST for action port [ 629.264713] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa46e0ea-568f-4c50-a725-6d162fee238a taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.268494] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa46e0ea-568f-4c50-a725-6d162fee238a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.268494] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa46e0ea-568f-4c50-a725-6d162fee238a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.268494] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa46e0ea-568f-4c50-a725-6d162fee238a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.268494] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa46e0ea-568f-4c50-a725-6d162fee238a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.268494] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa46e0ea-568f-4c50-a725-6d162fee238a taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.268494] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa46e0ea-568f-4c50-a725-6d162fee238a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.268494] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa46e0ea-568f-4c50-a725-6d162fee238a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.268494] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa46e0ea-568f-4c50-a725-6d162fee238a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.268494] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.268494] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.268494] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.268494] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.268494] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.268494] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa46e0ea-568f-4c50-a725-6d162fee238a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.270156] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-f5cc64a0-c79d-4164-93d9-09f30eed037a taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.270483] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f5cc64a0-c79d-4164-93d9-09f30eed037a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.270608] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f5cc64a0-c79d-4164-93d9-09f30eed037a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.271463] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f5cc64a0-c79d-4164-93d9-09f30eed037a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.271617] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5cc64a0-c79d-4164-93d9-09f30eed037a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.298699] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.299337] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.299503] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.299928] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.300322] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.330318] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 in Status: IN_PROGRESS for 2s [ 629.649374] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e4ca8456-5b21-4080-b762-7b52a4837eb1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.773485] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa46e0ea-568f-4c50-a725-6d162fee238a taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.773666] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa46e0ea-568f-4c50-a725-6d162fee238a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.773867] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa46e0ea-568f-4c50-a725-6d162fee238a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.774783] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f5cc64a0-c79d-4164-93d9-09f30eed037a with status ACTIVE [ 629.775256] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.775442] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.775509] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.775781] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.775832] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.777026] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.777026] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.777026] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.777026] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.777026] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.777026] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.777026] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.777026] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.777026] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.777026] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.777433] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f5cc64a0-c79d-4164-93d9-09f30eed037a is going to be updated. [ 629.801454] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.802165] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.802165] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.803624] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.803624] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.804070] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f5cc64a0-c79d-4164-93d9-09f30eed037a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.152363] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.152363] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.152490] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.152909] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.152945] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.153126] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 is going to be updated. [ 630.198867] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.199349] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.199349] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.199698] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.202037] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.214787] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 in Status: IN_PROGRESS for 2s [ 630.280480] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa46e0ea-568f-4c50-a725-6d162fee238a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.783882] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.784192] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.784235] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.784525] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.784652] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.784795] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa46e0ea-568f-4c50-a725-6d162fee238a is going to be created. [ 630.820361] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.820567] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.820749] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.820877] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.821089] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.837030] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa46e0ea-568f-4c50-a725-6d162fee238a in Status: UNINITIALIZED for 2s [ 631.111137] env[65471]: INFO networking_nsxv3.common.synchronization [req-d2cdad7b-f64b-4254-b580-25c90f66edcf req-bcbed0d4-e8c3-4f10-b162-2898d61bb5d5 tempest-DeleteServersAdminTestJSON-660962701 tempest-DeleteServersAdminTestJSON-660962701-project-admin] Enqueued Resource ID: 49f0917b-c43e-421e-9ccf-fe8487bf2b37 with Priority: HIGHEST for action security_group_members [ 631.112132] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49f0917b-c43e-421e-9ccf-fe8487bf2b37 with Priority: HIGHEST for action security_group_members [ 631.112132] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-49f0917b-c43e-421e-9ccf-fe8487bf2b37 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.112310] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49f0917b-c43e-421e-9ccf-fe8487bf2b37" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.112418] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49f0917b-c43e-421e-9ccf-fe8487bf2b37" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.112659] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49f0917b-c43e-421e-9ccf-fe8487bf2b37" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.112875] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.113088] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.113135] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.113331] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.113536] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.113695] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49f0917b-c43e-421e-9ccf-fe8487bf2b37',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.181169] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 in Status: SUCCESS [ 631.181395] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.351475] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 in Status: SUCCESS [ 631.351971] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.352242] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.352490] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.352597] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e4ca8456-5b21-4080-b762-7b52a4837eb1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.548272] env[65471]: INFO networking_nsxv3.common.synchronization [req-121d5394-fffe-490a-97bc-9c9ad456537e req-31972a3a-4f68-4425-a534-12f2ce27b60a tempest-VolumesAdminNegativeTest-396097261 tempest-VolumesAdminNegativeTest-396097261-project-member] Enqueued Resource ID: b04574ca-6910-4de6-a76c-d7d90c7e2e0c with Priority: HIGHEST for action security_group_members [ 631.548893] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b04574ca-6910-4de6-a76c-d7d90c7e2e0c with Priority: HIGHEST for action security_group_members [ 631.549970] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-b04574ca-6910-4de6-a76c-d7d90c7e2e0c taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.551619] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b04574ca-6910-4de6-a76c-d7d90c7e2e0c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.551619] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b04574ca-6910-4de6-a76c-d7d90c7e2e0c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.551619] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b04574ca-6910-4de6-a76c-d7d90c7e2e0c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.551619] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.551619] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.551619] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.551619] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.551619] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.551619] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b04574ca-6910-4de6-a76c-d7d90c7e2e0c',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.615445] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.615767] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.615854] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.616110] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.616222] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.616455] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.616566] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.616629] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.617061] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.617307] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.617307] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49f0917b-c43e-421e-9ccf-fe8487bf2b37 is going to be updated. [ 631.653051] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.653303] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.653303] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.653501] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.653732] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.666989] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49f0917b-c43e-421e-9ccf-fe8487bf2b37 in Status: IN_PROGRESS for 2s [ 631.855277] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4ca8456-5b21-4080-b762-7b52a4837eb1 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.856514] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.068679] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.068679] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.068679] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.068679] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.068679] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.068679] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.068679] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.068679] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.068679] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.068679] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.068679] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b04574ca-6910-4de6-a76c-d7d90c7e2e0c already deleted. [ 632.068679] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b04574ca-6910-4de6-a76c-d7d90c7e2e0c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.131189] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock network-639 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.131458] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "network-639" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.132089] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "network-639" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.132522] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "network-639" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.134145] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.134433] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.136155] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.136155] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.136319] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.136562] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 632.136707] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 632.138095] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 632.138267] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 632.138445] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 632.138630] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 632.138729] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 632.171534] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 632.171534] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 632.171534] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 632.171534] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "network-639" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.171858] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock port-789d29a9-358d-4f1f-bbe2-964db18a47c7 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.171858] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "port-789d29a9-358d-4f1f-bbe2-964db18a47c7" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.171858] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "port-789d29a9-358d-4f1f-bbe2-964db18a47c7" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.172213] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "port-789d29a9-358d-4f1f-bbe2-964db18a47c7" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.172349] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('789d29a9-358d-4f1f-bbe2-964db18a47c7',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.230256] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 in Status: SUCCESS [ 632.230527] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.230776] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.231054] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.231324] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.231484] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.231567] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.231806] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.231911] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.232052] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.232164] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e4ca8456-5b21-4080-b762-7b52a4837eb1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.305567] env[65471]: INFO networking_nsxv3.common.synchronization [None req-e7fafa81-821e-473f-8ca7-5b0d8d08aa5d None None] Enqueued Resource ID: 48008c12-4eb6-4d18-80e9-b033b7776b36 with Priority: HIGHEST for action port [ 632.306085] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48008c12-4eb6-4d18-80e9-b033b7776b36 with Priority: HIGHEST for action port [ 632.306615] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-48008c12-4eb6-4d18-80e9-b033b7776b36 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.306760] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48008c12-4eb6-4d18-80e9-b033b7776b36" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.306880] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48008c12-4eb6-4d18-80e9-b033b7776b36" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.307226] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48008c12-4eb6-4d18-80e9-b033b7776b36" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.307328] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48008c12-4eb6-4d18-80e9-b033b7776b36',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.674686] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.674938] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.675122] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.675468] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.675668] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.675851] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Segment Port 789d29a9-358d-4f1f-bbe2-964db18a47c7 not found, creating... [ 632.676187] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.676407] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.676561] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.676875] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.677079] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.677486] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.677733] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.677896] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.678537] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.678726] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.678917] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Resource: SegmentPort with ID: 789d29a9-358d-4f1f-bbe2-964db18a47c7 is going to be created. [ 632.704880] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.705247] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.705346] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.705634] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.705933] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.706218] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "port-789d29a9-358d-4f1f-bbe2-964db18a47c7" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.734934] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4ca8456-5b21-4080-b762-7b52a4837eb1 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.735167] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.735333] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.735639] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.736144] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.736144] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.736144] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.736345] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.736345] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.736405] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.736640] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4ca8456-5b21-4080-b762-7b52a4837eb1 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.736739] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.736791] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.736944] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.737154] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.737331] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.737331] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.737464] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.737686] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.737749] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.737844] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e4ca8456-5b21-4080-b762-7b52a4837eb1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.809678] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 48008c12-4eb6-4d18-80e9-b033b7776b36 [ 632.810142] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.810381] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.810453] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.810791] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.810935] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.811131] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:48008c12-4eb6-4d18-80e9-b033b7776b36 already deleted. [ 632.811325] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48008c12-4eb6-4d18-80e9-b033b7776b36" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.850845] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa46e0ea-568f-4c50-a725-6d162fee238a in Status: SUCCESS [ 632.851306] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa46e0ea-568f-4c50-a725-6d162fee238a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.852073] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa46e0ea-568f-4c50-a725-6d162fee238a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.852073] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa46e0ea-568f-4c50-a725-6d162fee238a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.852269] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.852364] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.852441] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.852660] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.852785] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.852857] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa46e0ea-568f-4c50-a725-6d162fee238a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.853071] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aa46e0ea-568f-4c50-a725-6d162fee238a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.243900] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e4ca8456-5b21-4080-b762-7b52a4837eb1: rpc.has_security_group_logging(os_id): False [ 633.268289] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.268289] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.268289] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.268513] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.268609] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.269215] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.269343] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.269405] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.269625] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.269761] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.269896] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.269997] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.270070] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.270263] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.270339] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.270545] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.270656] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.270717] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.270837] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.270908] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.270995] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 is going to be updated. [ 633.358666] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aa46e0ea-568f-4c50-a725-6d162fee238a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.404104] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.404104] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.404104] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.404104] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.404104] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.423161] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 in Status: IN_PROGRESS for 2s [ 633.512658] env[65471]: INFO networking_nsxv3.common.synchronization [req-121d5394-fffe-490a-97bc-9c9ad456537e req-daa51c39-f5d1-42cb-b455-27d621f6db00 service nova] Enqueued Resource ID: b04574ca-6910-4de6-a76c-d7d90c7e2e0c with Priority: HIGHEST for action security_group_rules [ 633.512658] env[65471]: INFO networking_nsxv3.common.synchronization [req-121d5394-fffe-490a-97bc-9c9ad456537e req-daa51c39-f5d1-42cb-b455-27d621f6db00 service nova] Enqueued Resource ID: b04574ca-6910-4de6-a76c-d7d90c7e2e0c with Priority: HIGHEST for action security_group_members [ 633.513458] env[65471]: INFO networking_nsxv3.common.synchronization [req-121d5394-fffe-490a-97bc-9c9ad456537e req-daa51c39-f5d1-42cb-b455-27d621f6db00 service nova] Enqueued Resource ID: 789d29a9-358d-4f1f-bbe2-964db18a47c7 with Priority: HIGHEST for action port [ 633.513750] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b04574ca-6910-4de6-a76c-d7d90c7e2e0c with Priority: HIGHEST for action security_group_rules [ 633.514203] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b04574ca-6910-4de6-a76c-d7d90c7e2e0c with Priority: HIGHEST for action security_group_members [ 633.514411] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 789d29a9-358d-4f1f-bbe2-964db18a47c7 with Priority: HIGHEST for action port [ 633.514798] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b04574ca-6910-4de6-a76c-d7d90c7e2e0c taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.515027] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b04574ca-6910-4de6-a76c-d7d90c7e2e0c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.515091] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b04574ca-6910-4de6-a76c-d7d90c7e2e0c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.515407] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b04574ca-6910-4de6-a76c-d7d90c7e2e0c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.515520] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b04574ca-6910-4de6-a76c-d7d90c7e2e0c',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.519030] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-b04574ca-6910-4de6-a76c-d7d90c7e2e0c taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.519030] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b04574ca-6910-4de6-a76c-d7d90c7e2e0c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.519030] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b04574ca-6910-4de6-a76c-d7d90c7e2e0c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.519030] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b04574ca-6910-4de6-a76c-d7d90c7e2e0c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.519030] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.519030] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.519030] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.519030] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.519030] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.519817] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b04574ca-6910-4de6-a76c-d7d90c7e2e0c',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.520249] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-789d29a9-358d-4f1f-bbe2-964db18a47c7 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.520596] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-789d29a9-358d-4f1f-bbe2-964db18a47c7" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.520596] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-789d29a9-358d-4f1f-bbe2-964db18a47c7" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.520698] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-789d29a9-358d-4f1f-bbe2-964db18a47c7" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.521033] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('789d29a9-358d-4f1f-bbe2-964db18a47c7',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.678213] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49f0917b-c43e-421e-9ccf-fe8487bf2b37 in Status: SUCCESS [ 633.678213] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49f0917b-c43e-421e-9ccf-fe8487bf2b37 deletion is rescheduled due to dependency. [ 633.678213] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49f0917b-c43e-421e-9ccf-fe8487bf2b37" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.865097] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aa46e0ea-568f-4c50-a725-6d162fee238a: rpc.has_security_group_logging(os_id): False [ 633.886036] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.886490] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.887740] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.887740] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.887740] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.887740] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.887740] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.887740] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.887740] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.887740] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.887740] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa46e0ea-568f-4c50-a725-6d162fee238a is going to be created. [ 633.981362] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.981590] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.981704] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.981916] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.982466] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.997200] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa46e0ea-568f-4c50-a725-6d162fee238a in Status: IN_PROGRESS for 2s [ 634.022985] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b04574ca-6910-4de6-a76c-d7d90c7e2e0c',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.027021] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-b04574ca-6910-4de6-a76c-d7d90c7e2e0c taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.027233] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b04574ca-6910-4de6-a76c-d7d90c7e2e0c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.027518] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 789d29a9-358d-4f1f-bbe2-964db18a47c7 with status ACTIVE [ 634.027721] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.030957] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.031134] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.031404] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.031503] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.031720] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.031852] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.031929] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.032570] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.032570] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.032570] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.032757] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.032757] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.032831] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.032913] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.032997] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 789d29a9-358d-4f1f-bbe2-964db18a47c7 is going to be updated. [ 634.066809] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.066809] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.066809] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.066809] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.066809] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.066809] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-789d29a9-358d-4f1f-bbe2-964db18a47c7" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.424067] env[65471]: INFO networking_nsxv3.common.synchronization [req-39aacfc6-9662-4df0-801f-a1e53bfb4117 req-415b2b2f-5405-4e79-b2df-0229f674aeba tempest-ServersAdminNegativeTestJSON-7494399 tempest-ServersAdminNegativeTestJSON-7494399-project-member] Enqueued Resource ID: 14a38584-d8ef-4361-b344-b91e376144fa with Priority: HIGHEST for action security_group_members [ 634.424644] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14a38584-d8ef-4361-b344-b91e376144fa with Priority: HIGHEST for action security_group_members [ 634.424977] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-14a38584-d8ef-4361-b344-b91e376144fa taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.425601] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14a38584-d8ef-4361-b344-b91e376144fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.425601] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14a38584-d8ef-4361-b344-b91e376144fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.425601] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14a38584-d8ef-4361-b344-b91e376144fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.425694] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.425748] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.425779] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.426042] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.426042] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.426140] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14a38584-d8ef-4361-b344-b91e376144fa',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.528447] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b04574ca-6910-4de6-a76c-d7d90c7e2e0c',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.930012] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock network-647 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.930012] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "network-647" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.930012] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "network-647" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.930012] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "network-647" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.930012] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.930012] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.930356] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.930693] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.930974] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.931290] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 634.931529] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 634.931860] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 634.932089] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 634.938166] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 634.938166] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 634.938166] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 634.938166] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.938166] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.938166] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.938166] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.938585] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.938910] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.939228] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.939434] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.939740] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.939950] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.940148] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14a38584-d8ef-4361-b344-b91e376144fa already deleted. [ 634.940355] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14a38584-d8ef-4361-b344-b91e376144fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.966037] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 634.966037] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 634.966037] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 634.966250] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "network-647" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.966481] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock port-81d59e89-5bf1-4c40-8801-fe5bc10075da taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.966734] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "port-81d59e89-5bf1-4c40-8801-fe5bc10075da" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.966888] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "port-81d59e89-5bf1-4c40-8801-fe5bc10075da" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.967275] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "port-81d59e89-5bf1-4c40-8801-fe5bc10075da" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.967491] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81d59e89-5bf1-4c40-8801-fe5bc10075da',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.031541] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.031693] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.031790] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.032018] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.032135] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.032220] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b04574ca-6910-4de6-a76c-d7d90c7e2e0c is going to be created. [ 635.061969] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.062211] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.062330] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.062629] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.062846] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.075158] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b04574ca-6910-4de6-a76c-d7d90c7e2e0c in Status: UNINITIALIZED for 2s [ 635.115214] env[65471]: INFO networking_nsxv3.common.synchronization [None req-09b59371-b896-41a0-83a1-f680df5f74b4 None None] Enqueued Resource ID: 9a4434ce-ee4e-43f9-b52b-64e841682384 with Priority: HIGHEST for action port [ 635.115214] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a4434ce-ee4e-43f9-b52b-64e841682384 with Priority: HIGHEST for action port [ 635.116589] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-9a4434ce-ee4e-43f9-b52b-64e841682384 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.117081] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9a4434ce-ee4e-43f9-b52b-64e841682384" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.117359] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9a4434ce-ee4e-43f9-b52b-64e841682384" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.118989] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9a4434ce-ee4e-43f9-b52b-64e841682384" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.118989] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a4434ce-ee4e-43f9-b52b-64e841682384',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.441171] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 in Status: SUCCESS [ 635.441552] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.470916] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.471175] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.471330] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.471622] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.471779] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.471931] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Segment Port 81d59e89-5bf1-4c40-8801-fe5bc10075da not found, creating... [ 635.472227] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.472389] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.472503] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.472939] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.472939] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.473177] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.473347] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.473457] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.473663] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.473789] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.473917] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Resource: SegmentPort with ID: 81d59e89-5bf1-4c40-8801-fe5bc10075da is going to be created. [ 635.500949] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.501404] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.501723] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.502089] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.502335] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.502644] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "port-81d59e89-5bf1-4c40-8801-fe5bc10075da" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.625443] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9a4434ce-ee4e-43f9-b52b-64e841682384 [ 635.626055] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.626491] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.626491] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.626832] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.626949] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.627091] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9a4434ce-ee4e-43f9-b52b-64e841682384 already deleted. [ 635.627211] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9a4434ce-ee4e-43f9-b52b-64e841682384" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.697421] env[65471]: INFO networking_nsxv3.common.synchronization [req-d4753aeb-e97d-4f27-bf4f-e3f3d3fb8cfb req-b61648c1-97aa-45c4-a58c-388304531c61 tempest-ServerDiagnosticsTest-1950138792 tempest-ServerDiagnosticsTest-1950138792-project-member] Enqueued Resource ID: bbd99ac4-1db4-4ccf-af90-c6ef33212f88 with Priority: HIGHEST for action security_group_members [ 635.698336] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbd99ac4-1db4-4ccf-af90-c6ef33212f88 with Priority: HIGHEST for action security_group_members [ 635.698737] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbd99ac4-1db4-4ccf-af90-c6ef33212f88 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.698909] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbd99ac4-1db4-4ccf-af90-c6ef33212f88" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.699142] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbd99ac4-1db4-4ccf-af90-c6ef33212f88" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.699395] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbd99ac4-1db4-4ccf-af90-c6ef33212f88" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.699606] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.699993] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.700134] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.700414] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.700536] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.700675] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbd99ac4-1db4-4ccf-af90-c6ef33212f88',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.012560] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa46e0ea-568f-4c50-a725-6d162fee238a in Status: SUCCESS [ 636.012991] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa46e0ea-568f-4c50-a725-6d162fee238a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.202576] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.202740] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.202809] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.203120] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.203259] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.203481] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.203778] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.203861] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.203994] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.204085] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.204177] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbd99ac4-1db4-4ccf-af90-c6ef33212f88 is going to be updated. [ 636.243058] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.243222] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.243291] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.243514] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.243655] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.254904] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbd99ac4-1db4-4ccf-af90-c6ef33212f88 in Status: IN_PROGRESS for 2s [ 636.257413] env[65471]: INFO networking_nsxv3.common.synchronization [req-39aacfc6-9662-4df0-801f-a1e53bfb4117 req-ab35405b-c5ae-4c13-8695-bc3070e4c51f service nova] Enqueued Resource ID: 14a38584-d8ef-4361-b344-b91e376144fa with Priority: HIGHEST for action security_group_rules [ 636.257506] env[65471]: INFO networking_nsxv3.common.synchronization [req-39aacfc6-9662-4df0-801f-a1e53bfb4117 req-ab35405b-c5ae-4c13-8695-bc3070e4c51f service nova] Enqueued Resource ID: 14a38584-d8ef-4361-b344-b91e376144fa with Priority: HIGHEST for action security_group_members [ 636.257600] env[65471]: INFO networking_nsxv3.common.synchronization [req-39aacfc6-9662-4df0-801f-a1e53bfb4117 req-ab35405b-c5ae-4c13-8695-bc3070e4c51f service nova] Enqueued Resource ID: 81d59e89-5bf1-4c40-8801-fe5bc10075da with Priority: HIGHEST for action port [ 636.258445] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14a38584-d8ef-4361-b344-b91e376144fa with Priority: HIGHEST for action security_group_rules [ 636.258445] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14a38584-d8ef-4361-b344-b91e376144fa with Priority: HIGHEST for action security_group_members [ 636.258445] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81d59e89-5bf1-4c40-8801-fe5bc10075da with Priority: HIGHEST for action port [ 636.258681] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14a38584-d8ef-4361-b344-b91e376144fa taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.258781] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14a38584-d8ef-4361-b344-b91e376144fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.258833] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14a38584-d8ef-4361-b344-b91e376144fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.259101] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14a38584-d8ef-4361-b344-b91e376144fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.259222] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14a38584-d8ef-4361-b344-b91e376144fa',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.260106] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-14a38584-d8ef-4361-b344-b91e376144fa taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.260296] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14a38584-d8ef-4361-b344-b91e376144fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.262816] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14a38584-d8ef-4361-b344-b91e376144fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.262816] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14a38584-d8ef-4361-b344-b91e376144fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.262816] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.262816] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.262816] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.262816] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.262816] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.262816] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14a38584-d8ef-4361-b344-b91e376144fa',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.263604] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-81d59e89-5bf1-4c40-8801-fe5bc10075da taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.263604] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-81d59e89-5bf1-4c40-8801-fe5bc10075da" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.263604] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-81d59e89-5bf1-4c40-8801-fe5bc10075da" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.263604] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-81d59e89-5bf1-4c40-8801-fe5bc10075da" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.263604] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81d59e89-5bf1-4c40-8801-fe5bc10075da',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.421729] env[65471]: INFO networking_nsxv3.common.synchronization [req-056c2165-5cc2-44bf-8a0a-a616551afb32 req-a06879f8-76ad-4b36-9dee-ee06c4dcca84 tempest-ImagesNegativeTestJSON-1441832217 tempest-ImagesNegativeTestJSON-1441832217-project-member] Enqueued Resource ID: 2701e2a3-bfcb-431d-b91c-91e91e5af6e1 with Priority: HIGHEST for action security_group_members [ 636.422679] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2701e2a3-bfcb-431d-b91c-91e91e5af6e1 with Priority: HIGHEST for action security_group_members [ 636.423426] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-2701e2a3-bfcb-431d-b91c-91e91e5af6e1 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.425533] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2701e2a3-bfcb-431d-b91c-91e91e5af6e1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.425533] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2701e2a3-bfcb-431d-b91c-91e91e5af6e1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.425533] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2701e2a3-bfcb-431d-b91c-91e91e5af6e1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.425533] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.425533] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.425533] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.425533] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.425533] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.425533] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2701e2a3-bfcb-431d-b91c-91e91e5af6e1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.530931] env[65471]: INFO networking_nsxv3.common.synchronization [req-55c1b932-bd8d-40f7-9585-6d057c9d6ecd req-a328cf02-bfd9-435f-8858-fb53ff54f736 tempest-ServerRescueTestJSONUnderV235-906155078 tempest-ServerRescueTestJSONUnderV235-906155078-project-member] Enqueued Resource ID: 7cefc497-117e-45da-bc1f-1ab0ea166d74 with Priority: HIGHEST for action security_group_members [ 636.530931] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cefc497-117e-45da-bc1f-1ab0ea166d74 with Priority: HIGHEST for action security_group_members [ 636.530931] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cefc497-117e-45da-bc1f-1ab0ea166d74 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.530931] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.530931] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.532204] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.532375] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.532502] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.532569] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.532752] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.532844] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.532939] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7cefc497-117e-45da-bc1f-1ab0ea166d74',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.767055] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-14a38584-d8ef-4361-b344-b91e376144fa taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.767055] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14a38584-d8ef-4361-b344-b91e376144fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.767055] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('14a38584-d8ef-4361-b344-b91e376144fa',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.767318] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 81d59e89-5bf1-4c40-8801-fe5bc10075da with status ACTIVE [ 636.768016] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.768016] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.768016] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.768016] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.768016] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.768314] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.768314] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.768314] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.768457] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.768503] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.768713] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.768813] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.768876] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.769347] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.769642] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.769897] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 81d59e89-5bf1-4c40-8801-fe5bc10075da is going to be updated. [ 636.797940] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.798162] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.798303] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.798583] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.798758] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.799435] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-81d59e89-5bf1-4c40-8801-fe5bc10075da" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.910873] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock network-530 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.911091] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "network-530" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.911232] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "network-530" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.911556] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "network-530" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.911813] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.911963] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.912085] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.912296] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.912429] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.912621] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 636.912769] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 636.912835] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 636.912916] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 636.913056] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 636.913207] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 636.913379] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 636.927499] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.927696] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.927866] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.928132] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.928235] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.928439] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.928539] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.928601] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.928757] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.928928] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.928928] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2701e2a3-bfcb-431d-b91c-91e91e5af6e1 is going to be updated. [ 636.945564] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 636.945734] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 636.945866] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 636.946083] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "network-530" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.946366] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock port-e31cbb04-c49d-4616-bb6f-99d8d7f78332 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.946587] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "port-e31cbb04-c49d-4616-bb6f-99d8d7f78332" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.946758] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "port-e31cbb04-c49d-4616-bb6f-99d8d7f78332" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.947181] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "port-e31cbb04-c49d-4616-bb6f-99d8d7f78332" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.947277] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e31cbb04-c49d-4616-bb6f-99d8d7f78332',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.963833] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.963989] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.964076] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.964333] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.964435] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.975107] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2701e2a3-bfcb-431d-b91c-91e91e5af6e1 in Status: IN_PROGRESS for 2s [ 637.035559] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.035798] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.035798] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.035998] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.036970] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.036970] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.036970] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.036970] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.036970] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.036970] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.036970] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7cefc497-117e-45da-bc1f-1ab0ea166d74 already deleted. [ 637.036970] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.088225] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b04574ca-6910-4de6-a76c-d7d90c7e2e0c in Status: SUCCESS [ 637.088225] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b04574ca-6910-4de6-a76c-d7d90c7e2e0c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.088225] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b04574ca-6910-4de6-a76c-d7d90c7e2e0c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.088225] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b04574ca-6910-4de6-a76c-d7d90c7e2e0c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.088389] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.088455] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.088455] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.090077] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.090077] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.090077] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b04574ca-6910-4de6-a76c-d7d90c7e2e0c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.090077] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b04574ca-6910-4de6-a76c-d7d90c7e2e0c',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.273268] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('14a38584-d8ef-4361-b344-b91e376144fa',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.450408] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.450805] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.451186] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.451631] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.451820] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.452015] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Segment Port e31cbb04-c49d-4616-bb6f-99d8d7f78332 not found, creating... [ 637.452388] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.452774] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.453078] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.454040] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.454040] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.454040] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.454040] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.454040] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.454400] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.454611] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.454782] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Resource: SegmentPort with ID: e31cbb04-c49d-4616-bb6f-99d8d7f78332 is going to be created. [ 637.478299] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.478533] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.478909] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.478909] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.479188] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.479430] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "port-e31cbb04-c49d-4616-bb6f-99d8d7f78332" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.593644] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-b04574ca-6910-4de6-a76c-d7d90c7e2e0c taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.593644] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b04574ca-6910-4de6-a76c-d7d90c7e2e0c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.594050] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b04574ca-6910-4de6-a76c-d7d90c7e2e0c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.594050] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b04574ca-6910-4de6-a76c-d7d90c7e2e0c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.594231] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.594349] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.594415] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.594603] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.594705] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.594815] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b04574ca-6910-4de6-a76c-d7d90c7e2e0c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.594983] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-b04574ca-6910-4de6-a76c-d7d90c7e2e0c taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.595097] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b04574ca-6910-4de6-a76c-d7d90c7e2e0c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.595160] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b04574ca-6910-4de6-a76c-d7d90c7e2e0c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.595309] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b04574ca-6910-4de6-a76c-d7d90c7e2e0c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.595472] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.595578] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.595640] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.596310] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.596310] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.596310] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b04574ca-6910-4de6-a76c-d7d90c7e2e0c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.596310] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b04574ca-6910-4de6-a76c-d7d90c7e2e0c',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.777638] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.777638] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.777638] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.777955] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.777955] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.778067] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14a38584-d8ef-4361-b344-b91e376144fa is going to be created. [ 637.809053] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.809053] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.809053] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.809624] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.809624] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.822632] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14a38584-d8ef-4361-b344-b91e376144fa in Status: UNINITIALIZED for 2s [ 638.102397] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b04574ca-6910-4de6-a76c-d7d90c7e2e0c: rpc.has_security_group_logging(os_id): False [ 638.120462] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.121320] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.121320] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.121320] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.121320] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.121879] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.121879] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.121879] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.121879] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.122079] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.122115] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.122199] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.122259] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.122496] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.122496] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.122641] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.122743] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.122778] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.122915] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.123024] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.123068] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b04574ca-6910-4de6-a76c-d7d90c7e2e0c is going to be created. [ 638.193197] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.194716] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.194716] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.194716] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.194716] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.207496] env[65471]: INFO networking_nsxv3.common.synchronization [req-55c1b932-bd8d-40f7-9585-6d057c9d6ecd req-eb0abc7e-324a-4872-a72b-6ce54147175b service nova] Enqueued Resource ID: 7cefc497-117e-45da-bc1f-1ab0ea166d74 with Priority: HIGHEST for action security_group_rules [ 638.207680] env[65471]: INFO networking_nsxv3.common.synchronization [req-55c1b932-bd8d-40f7-9585-6d057c9d6ecd req-eb0abc7e-324a-4872-a72b-6ce54147175b service nova] Enqueued Resource ID: 7cefc497-117e-45da-bc1f-1ab0ea166d74 with Priority: HIGHEST for action security_group_members [ 638.207811] env[65471]: INFO networking_nsxv3.common.synchronization [req-55c1b932-bd8d-40f7-9585-6d057c9d6ecd req-eb0abc7e-324a-4872-a72b-6ce54147175b service nova] Enqueued Resource ID: e31cbb04-c49d-4616-bb6f-99d8d7f78332 with Priority: HIGHEST for action port [ 638.208689] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b04574ca-6910-4de6-a76c-d7d90c7e2e0c in Status: IN_PROGRESS for 2s [ 638.209116] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cefc497-117e-45da-bc1f-1ab0ea166d74 with Priority: HIGHEST for action security_group_rules [ 638.209293] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cefc497-117e-45da-bc1f-1ab0ea166d74 with Priority: HIGHEST for action security_group_members [ 638.209432] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e31cbb04-c49d-4616-bb6f-99d8d7f78332 with Priority: HIGHEST for action port [ 638.209713] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7cefc497-117e-45da-bc1f-1ab0ea166d74 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.209834] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.209901] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.210191] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.210267] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7cefc497-117e-45da-bc1f-1ab0ea166d74',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.211402] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cefc497-117e-45da-bc1f-1ab0ea166d74 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.211506] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.211576] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.211744] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.211887] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.211980] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.212053] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.212195] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.212282] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.212389] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7cefc497-117e-45da-bc1f-1ab0ea166d74',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.213437] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-e31cbb04-c49d-4616-bb6f-99d8d7f78332 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.213545] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e31cbb04-c49d-4616-bb6f-99d8d7f78332" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.213613] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e31cbb04-c49d-4616-bb6f-99d8d7f78332" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.213761] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e31cbb04-c49d-4616-bb6f-99d8d7f78332" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.213836] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e31cbb04-c49d-4616-bb6f-99d8d7f78332',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.271177] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbd99ac4-1db4-4ccf-af90-c6ef33212f88 in Status: SUCCESS [ 638.271365] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbd99ac4-1db4-4ccf-af90-c6ef33212f88 deletion is rescheduled due to dependency. [ 638.271483] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbd99ac4-1db4-4ccf-af90-c6ef33212f88" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.716307] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cefc497-117e-45da-bc1f-1ab0ea166d74 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.716307] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.716307] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7cefc497-117e-45da-bc1f-1ab0ea166d74',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.716734] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e31cbb04-c49d-4616-bb6f-99d8d7f78332 with status ACTIVE [ 638.716734] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.716734] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.716734] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.716920] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.717039] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.717268] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.717356] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.717414] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.717585] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.717653] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.718677] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.718677] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.718677] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.719695] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.722904] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.722904] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e31cbb04-c49d-4616-bb6f-99d8d7f78332 is going to be updated. [ 638.746826] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.747577] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.747577] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.747577] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.747577] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.747577] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e31cbb04-c49d-4616-bb6f-99d8d7f78332" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.988640] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2701e2a3-bfcb-431d-b91c-91e91e5af6e1 in Status: SUCCESS [ 638.988918] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2701e2a3-bfcb-431d-b91c-91e91e5af6e1 deletion is rescheduled due to dependency. [ 638.989080] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2701e2a3-bfcb-431d-b91c-91e91e5af6e1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.225416] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7cefc497-117e-45da-bc1f-1ab0ea166d74',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.731669] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.732064] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.732064] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.733038] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.733038] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.733038] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7cefc497-117e-45da-bc1f-1ab0ea166d74 is going to be created. [ 639.760061] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.760228] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.760469] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.760600] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.760764] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.771264] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cefc497-117e-45da-bc1f-1ab0ea166d74 in Status: UNINITIALIZED for 2s [ 639.834842] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14a38584-d8ef-4361-b344-b91e376144fa in Status: SUCCESS [ 639.834842] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14a38584-d8ef-4361-b344-b91e376144fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.834842] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14a38584-d8ef-4361-b344-b91e376144fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.834842] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14a38584-d8ef-4361-b344-b91e376144fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.834842] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.834842] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.834842] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.834842] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.834842] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.834842] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14a38584-d8ef-4361-b344-b91e376144fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.834842] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('14a38584-d8ef-4361-b344-b91e376144fa',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.227063] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b04574ca-6910-4de6-a76c-d7d90c7e2e0c in Status: SUCCESS [ 640.227063] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b04574ca-6910-4de6-a76c-d7d90c7e2e0c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.337185] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-14a38584-d8ef-4361-b344-b91e376144fa taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.337414] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14a38584-d8ef-4361-b344-b91e376144fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.337491] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14a38584-d8ef-4361-b344-b91e376144fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.337725] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14a38584-d8ef-4361-b344-b91e376144fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.337933] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.338089] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.338176] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.338350] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.338464] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.338561] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14a38584-d8ef-4361-b344-b91e376144fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.338719] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-14a38584-d8ef-4361-b344-b91e376144fa taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.338812] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14a38584-d8ef-4361-b344-b91e376144fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.338876] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14a38584-d8ef-4361-b344-b91e376144fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.339034] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14a38584-d8ef-4361-b344-b91e376144fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.339181] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.339305] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.339373] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.339589] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.339677] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.339764] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14a38584-d8ef-4361-b344-b91e376144fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.339858] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('14a38584-d8ef-4361-b344-b91e376144fa',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.696914] env[65471]: INFO networking_nsxv3.common.synchronization [None req-353d3f5c-a5c2-4e1a-b437-63103c2a051b tempest-ServersWithSpecificFlavorTestJSON-1911677354 tempest-ServersWithSpecificFlavorTestJSON-1911677354-project-member] Enqueued Resource ID: 57387769-3919-42b1-a3d7-3d45bcef516d with Priority: HIGHEST for action security_group_rules [ 640.697496] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57387769-3919-42b1-a3d7-3d45bcef516d with Priority: HIGHEST for action security_group_rules [ 640.697802] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57387769-3919-42b1-a3d7-3d45bcef516d taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.697922] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57387769-3919-42b1-a3d7-3d45bcef516d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.697987] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57387769-3919-42b1-a3d7-3d45bcef516d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.698255] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57387769-3919-42b1-a3d7-3d45bcef516d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.698473] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57387769-3919-42b1-a3d7-3d45bcef516d',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.844551] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 14a38584-d8ef-4361-b344-b91e376144fa: rpc.has_security_group_logging(os_id): False [ 640.866507] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.866507] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.866507] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.866792] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.866792] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.866878] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.866995] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.869221] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.869221] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.869221] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.869221] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.869221] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.869221] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.869221] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.869221] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.869221] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.869221] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.869221] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.869221] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.869221] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.869221] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14a38584-d8ef-4361-b344-b91e376144fa is going to be created. [ 640.954696] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.954936] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.955027] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.955183] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.955373] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.970586] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 14a38584-d8ef-4361-b344-b91e376144fa in Status: IN_PROGRESS for 2s [ 641.032659] env[65471]: INFO networking_nsxv3.common.synchronization [None req-89ad41df-d64b-43f2-b0b7-e0e8b020891e tempest-ServersWithSpecificFlavorTestJSON-1911677354 tempest-ServersWithSpecificFlavorTestJSON-1911677354-project-member] Enqueued Resource ID: 57387769-3919-42b1-a3d7-3d45bcef516d with Priority: HIGHEST for action security_group_rules [ 641.033277] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57387769-3919-42b1-a3d7-3d45bcef516d with Priority: HIGHEST for action security_group_rules [ 641.033633] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57387769-3919-42b1-a3d7-3d45bcef516d taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.033740] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57387769-3919-42b1-a3d7-3d45bcef516d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.222009] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.222172] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.222292] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.222555] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.222648] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.222843] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57387769-3919-42b1-a3d7-3d45bcef516d already deleted. [ 641.222843] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57387769-3919-42b1-a3d7-3d45bcef516d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.223993] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57387769-3919-42b1-a3d7-3d45bcef516d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.223993] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57387769-3919-42b1-a3d7-3d45bcef516d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.223993] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57387769-3919-42b1-a3d7-3d45bcef516d',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.765938] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.765938] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.765938] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.765938] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.765938] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.765938] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57387769-3919-42b1-a3d7-3d45bcef516d already deleted. [ 641.765938] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57387769-3919-42b1-a3d7-3d45bcef516d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.796027] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cefc497-117e-45da-bc1f-1ab0ea166d74 in Status: SUCCESS [ 641.796243] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.797011] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.797011] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.797011] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.797011] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.797293] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.797293] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.797406] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.797508] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.797508] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7cefc497-117e-45da-bc1f-1ab0ea166d74',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.302046] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cefc497-117e-45da-bc1f-1ab0ea166d74 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.302046] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.302046] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.302779] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.302779] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.302779] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.302779] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.302990] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.302990] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.303071] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.307068] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cefc497-117e-45da-bc1f-1ab0ea166d74 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.307068] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.307068] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.307068] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.307068] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.307068] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.307068] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.307068] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.307068] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.307068] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.307068] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7cefc497-117e-45da-bc1f-1ab0ea166d74',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.312423] env[65471]: INFO networking_nsxv3.common.synchronization [None req-82223da5-00ae-40f1-bcd1-2c12f86d87e2 None None] Enqueued Resource ID: e4369cd0-ceae-4e11-86b7-fd39afa6c413 with Priority: HIGHEST for action port [ 642.314395] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4369cd0-ceae-4e11-86b7-fd39afa6c413 with Priority: HIGHEST for action port [ 642.314395] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-e4369cd0-ceae-4e11-86b7-fd39afa6c413 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.314395] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e4369cd0-ceae-4e11-86b7-fd39afa6c413" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.314395] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e4369cd0-ceae-4e11-86b7-fd39afa6c413" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.314395] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e4369cd0-ceae-4e11-86b7-fd39afa6c413" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.314658] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4369cd0-ceae-4e11-86b7-fd39afa6c413',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.807467] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7cefc497-117e-45da-bc1f-1ab0ea166d74: rpc.has_security_group_logging(os_id): False [ 642.821873] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e4369cd0-ceae-4e11-86b7-fd39afa6c413 [ 642.821873] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.821873] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.821873] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.821873] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.821873] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.821873] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e4369cd0-ceae-4e11-86b7-fd39afa6c413 already deleted. [ 642.821873] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e4369cd0-ceae-4e11-86b7-fd39afa6c413" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.834387] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.834387] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.834387] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.834387] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.834387] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.834387] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.834387] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.834387] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.834387] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.834387] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.834387] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.834387] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.834387] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.835038] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.835038] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.835038] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.835038] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.835038] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.835500] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.835567] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.835677] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7cefc497-117e-45da-bc1f-1ab0ea166d74 is going to be created. [ 642.931756] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.932041] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.932119] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.932364] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.932663] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.948315] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7cefc497-117e-45da-bc1f-1ab0ea166d74 in Status: IN_PROGRESS for 2s [ 642.990698] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 14a38584-d8ef-4361-b344-b91e376144fa in Status: SUCCESS [ 642.990905] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14a38584-d8ef-4361-b344-b91e376144fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.229622] env[65471]: INFO networking_nsxv3.common.synchronization [None req-cdf7bf51-b68c-4c69-8f78-0eedac217e76 None None] Enqueued Resource ID: 0b488f19-65cb-4e68-a694-d89799716062 with Priority: HIGHEST for action port [ 644.230234] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b488f19-65cb-4e68-a694-d89799716062 with Priority: HIGHEST for action port [ 644.230522] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-0b488f19-65cb-4e68-a694-d89799716062 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.231401] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0b488f19-65cb-4e68-a694-d89799716062" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.231401] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0b488f19-65cb-4e68-a694-d89799716062" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.231401] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0b488f19-65cb-4e68-a694-d89799716062" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.231401] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b488f19-65cb-4e68-a694-d89799716062',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.352526] env[65471]: INFO networking_nsxv3.common.synchronization [req-a62d56d0-149d-4093-800b-b42c973dab6f req-7f5886f7-c252-4e2b-8679-538cae6ef067 tempest-ServerAddressesTestJSON-1658806996 tempest-ServerAddressesTestJSON-1658806996-project-member] Enqueued Resource ID: 453acdc6-7d50-452b-bb4b-66af12a7624a with Priority: HIGHEST for action security_group_members [ 644.352649] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 453acdc6-7d50-452b-bb4b-66af12a7624a with Priority: HIGHEST for action security_group_members [ 644.353077] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-453acdc6-7d50-452b-bb4b-66af12a7624a taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.353206] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-453acdc6-7d50-452b-bb4b-66af12a7624a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.353278] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-453acdc6-7d50-452b-bb4b-66af12a7624a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.353534] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-453acdc6-7d50-452b-bb4b-66af12a7624a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.353690] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.353802] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.353877] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.354065] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.354164] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.354244] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('453acdc6-7d50-452b-bb4b-66af12a7624a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.738646] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0b488f19-65cb-4e68-a694-d89799716062 [ 644.738751] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.738935] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.739085] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.739404] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.739542] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.739670] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0b488f19-65cb-4e68-a694-d89799716062 already deleted. [ 644.739803] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0b488f19-65cb-4e68-a694-d89799716062" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.858874] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.858874] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.858874] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.858874] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.858874] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.858874] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.858874] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.858874] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.858874] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.858874] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.858874] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 453acdc6-7d50-452b-bb4b-66af12a7624a already deleted. [ 644.858874] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-453acdc6-7d50-452b-bb4b-66af12a7624a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.966307] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7cefc497-117e-45da-bc1f-1ab0ea166d74 in Status: SUCCESS [ 644.966307] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.049302] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock network-458 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.050081] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "network-458" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.050081] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "network-458" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.050404] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "network-458" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.050540] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.050671] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.052172] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.052585] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.052835] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.053155] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 645.053393] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 645.053684] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 645.053917] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 645.054131] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 645.054345] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 645.054566] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 645.077328] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 645.077564] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 645.077564] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 645.078638] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "network-458" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.078638] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock port-e72fd9f0-9a0c-4ba8-bbfc-1a239fb10368 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.078638] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "port-e72fd9f0-9a0c-4ba8-bbfc-1a239fb10368" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.078638] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "port-e72fd9f0-9a0c-4ba8-bbfc-1a239fb10368" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.078924] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "port-e72fd9f0-9a0c-4ba8-bbfc-1a239fb10368" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.078924] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e72fd9f0-9a0c-4ba8-bbfc-1a239fb10368',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.581474] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.581903] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.581903] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.582098] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.582198] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.582357] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Segment Port e72fd9f0-9a0c-4ba8-bbfc-1a239fb10368 not found, creating... [ 645.582626] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.582773] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.582882] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.583111] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.583246] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.583725] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.583901] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.584029] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.584239] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.584369] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.584504] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Resource: SegmentPort with ID: e72fd9f0-9a0c-4ba8-bbfc-1a239fb10368 is going to be created. [ 645.618377] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.618377] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.618377] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.618377] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.618582] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.618742] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "port-e72fd9f0-9a0c-4ba8-bbfc-1a239fb10368" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.314098] env[65471]: INFO networking_nsxv3.common.synchronization [None req-393a3c6a-f067-42c0-b0f5-c613bf8a2748 None None] Enqueued Resource ID: 9687d102-a7ec-4bcf-bc97-b114a29d83e7 with Priority: HIGHEST for action port [ 646.314727] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9687d102-a7ec-4bcf-bc97-b114a29d83e7 with Priority: HIGHEST for action port [ 646.315660] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-9687d102-a7ec-4bcf-bc97-b114a29d83e7 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.315869] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9687d102-a7ec-4bcf-bc97-b114a29d83e7" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.315976] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9687d102-a7ec-4bcf-bc97-b114a29d83e7" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.316397] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9687d102-a7ec-4bcf-bc97-b114a29d83e7" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.316397] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9687d102-a7ec-4bcf-bc97-b114a29d83e7',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.353675] env[65471]: INFO networking_nsxv3.common.synchronization [req-a62d56d0-149d-4093-800b-b42c973dab6f req-e946bc63-9828-4b1b-87fb-645835152d72 service nova] Enqueued Resource ID: 453acdc6-7d50-452b-bb4b-66af12a7624a with Priority: HIGHEST for action security_group_rules [ 646.354012] env[65471]: INFO networking_nsxv3.common.synchronization [req-a62d56d0-149d-4093-800b-b42c973dab6f req-e946bc63-9828-4b1b-87fb-645835152d72 service nova] Enqueued Resource ID: 453acdc6-7d50-452b-bb4b-66af12a7624a with Priority: HIGHEST for action security_group_members [ 646.354012] env[65471]: INFO networking_nsxv3.common.synchronization [req-a62d56d0-149d-4093-800b-b42c973dab6f req-e946bc63-9828-4b1b-87fb-645835152d72 service nova] Enqueued Resource ID: e72fd9f0-9a0c-4ba8-bbfc-1a239fb10368 with Priority: HIGHEST for action port [ 646.354480] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 453acdc6-7d50-452b-bb4b-66af12a7624a with Priority: HIGHEST for action security_group_rules [ 646.354618] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 453acdc6-7d50-452b-bb4b-66af12a7624a with Priority: HIGHEST for action security_group_members [ 646.354723] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e72fd9f0-9a0c-4ba8-bbfc-1a239fb10368 with Priority: HIGHEST for action port [ 646.355045] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-453acdc6-7d50-452b-bb4b-66af12a7624a taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.355172] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-453acdc6-7d50-452b-bb4b-66af12a7624a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.355239] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-453acdc6-7d50-452b-bb4b-66af12a7624a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.355538] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-453acdc6-7d50-452b-bb4b-66af12a7624a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.355570] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('453acdc6-7d50-452b-bb4b-66af12a7624a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.356699] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-453acdc6-7d50-452b-bb4b-66af12a7624a taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.356815] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-453acdc6-7d50-452b-bb4b-66af12a7624a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.356974] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-453acdc6-7d50-452b-bb4b-66af12a7624a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.357074] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-453acdc6-7d50-452b-bb4b-66af12a7624a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.357388] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.357484] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.357546] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.357690] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.358055] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.358055] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('453acdc6-7d50-452b-bb4b-66af12a7624a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.358760] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-e72fd9f0-9a0c-4ba8-bbfc-1a239fb10368 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.358894] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e72fd9f0-9a0c-4ba8-bbfc-1a239fb10368" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.358982] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e72fd9f0-9a0c-4ba8-bbfc-1a239fb10368" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.359129] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e72fd9f0-9a0c-4ba8-bbfc-1a239fb10368" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.359199] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e72fd9f0-9a0c-4ba8-bbfc-1a239fb10368',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.679129] env[65471]: INFO networking_nsxv3.common.synchronization [req-b1413cb4-53d1-48d2-98d9-d6e8b87314a9 req-9334052b-f6c7-4569-aad1-b48d66f0d567 tempest-ServerExternalEventsTest-1865778980 tempest-ServerExternalEventsTest-1865778980-project-member] Enqueued Resource ID: ceb1afc4-63ef-450a-b72c-5b79e8970a01 with Priority: HIGHEST for action security_group_members [ 646.679772] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ceb1afc4-63ef-450a-b72c-5b79e8970a01 with Priority: HIGHEST for action security_group_members [ 646.680529] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-ceb1afc4-63ef-450a-b72c-5b79e8970a01 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.680775] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ceb1afc4-63ef-450a-b72c-5b79e8970a01" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.682504] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ceb1afc4-63ef-450a-b72c-5b79e8970a01" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.682927] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ceb1afc4-63ef-450a-b72c-5b79e8970a01" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.683243] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.683454] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.683569] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.683805] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.683948] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.684335] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ceb1afc4-63ef-450a-b72c-5b79e8970a01',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.821276] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9687d102-a7ec-4bcf-bc97-b114a29d83e7 [ 646.821276] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.821276] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.821276] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.821276] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.821276] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.821276] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9687d102-a7ec-4bcf-bc97-b114a29d83e7 already deleted. [ 646.821276] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9687d102-a7ec-4bcf-bc97-b114a29d83e7" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.861586] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-453acdc6-7d50-452b-bb4b-66af12a7624a taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.862090] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-453acdc6-7d50-452b-bb4b-66af12a7624a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.862700] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('453acdc6-7d50-452b-bb4b-66af12a7624a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.864137] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e72fd9f0-9a0c-4ba8-bbfc-1a239fb10368 with status ACTIVE [ 646.864299] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.864452] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.864522] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.864752] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.864864] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.865312] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.865628] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.865743] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.866513] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.866735] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.867665] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.867921] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.867921] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.868118] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.868213] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.868321] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e72fd9f0-9a0c-4ba8-bbfc-1a239fb10368 is going to be updated. [ 646.892539] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.892539] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.892539] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.892765] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.892836] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.893082] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e72fd9f0-9a0c-4ba8-bbfc-1a239fb10368" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.187571] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.187890] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.187980] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.188247] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.188364] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.188574] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.188720] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.188775] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.188942] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.189022] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.189117] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ceb1afc4-63ef-450a-b72c-5b79e8970a01 is going to be updated. [ 647.227924] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.228210] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.228210] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.228384] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.228831] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.240834] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ceb1afc4-63ef-450a-b72c-5b79e8970a01 in Status: IN_PROGRESS for 2s [ 647.371856] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('453acdc6-7d50-452b-bb4b-66af12a7624a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.875480] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.875480] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.875480] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.875891] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.875891] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.876971] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 453acdc6-7d50-452b-bb4b-66af12a7624a is going to be created. [ 647.918257] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.918468] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.918468] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.918690] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.918867] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.931347] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 453acdc6-7d50-452b-bb4b-66af12a7624a in Status: UNINITIALIZED for 2s [ 648.170053] env[65471]: INFO networking_nsxv3.common.synchronization [req-cbc0c0a0-2781-4fbe-bcfd-9c3b7e834a56 req-aa155f80-6fe1-4121-8773-fd68dfed7c75 tempest-DeleteServersAdminTestJSON-1981732508 tempest-DeleteServersAdminTestJSON-1981732508-project-member] Enqueued Resource ID: 49f0917b-c43e-421e-9ccf-fe8487bf2b37 with Priority: HIGHEST for action security_group_members [ 648.172508] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49f0917b-c43e-421e-9ccf-fe8487bf2b37 with Priority: HIGHEST for action security_group_members [ 648.172916] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-49f0917b-c43e-421e-9ccf-fe8487bf2b37 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.173743] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49f0917b-c43e-421e-9ccf-fe8487bf2b37" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.173743] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49f0917b-c43e-421e-9ccf-fe8487bf2b37" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.173743] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49f0917b-c43e-421e-9ccf-fe8487bf2b37" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.173958] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.175507] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.175507] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.175507] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.175507] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.175507] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49f0917b-c43e-421e-9ccf-fe8487bf2b37',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.680028] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.680338] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.680338] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.682085] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.682085] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.682085] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.682085] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.682085] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.682085] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.682085] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.682085] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49f0917b-c43e-421e-9ccf-fe8487bf2b37 is going to be updated. [ 648.714202] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.714646] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.714646] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.714728] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.714961] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.727448] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49f0917b-c43e-421e-9ccf-fe8487bf2b37 in Status: IN_PROGRESS for 2s [ 648.888270] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock network-647 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.888667] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "network-647" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.888863] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "network-647" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.889225] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "network-647" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.889532] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.889720] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.889883] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.890092] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.890232] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.890477] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 648.890593] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 648.890694] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 648.890809] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 648.890915] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 648.891031] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 648.891160] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 648.912646] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 648.912880] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 648.913056] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 648.913220] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "network-647" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.913547] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock port-97610c64-962a-41f4-bc35-6a8b748710d2 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.913766] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "port-97610c64-962a-41f4-bc35-6a8b748710d2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.913887] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "port-97610c64-962a-41f4-bc35-6a8b748710d2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.914280] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "port-97610c64-962a-41f4-bc35-6a8b748710d2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.914433] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97610c64-962a-41f4-bc35-6a8b748710d2',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.963022] env[65471]: INFO networking_nsxv3.common.synchronization [None req-67d1f658-e39a-4b0d-b5b4-ef525ea51680 None None] Enqueued Resource ID: e205a454-9031-4fe4-88da-8cec8c028735 with Priority: HIGHEST for action port [ 648.963022] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e205a454-9031-4fe4-88da-8cec8c028735 with Priority: HIGHEST for action port [ 648.963359] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-e205a454-9031-4fe4-88da-8cec8c028735 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.963498] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e205a454-9031-4fe4-88da-8cec8c028735" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.963567] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e205a454-9031-4fe4-88da-8cec8c028735" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.964330] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e205a454-9031-4fe4-88da-8cec8c028735" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.964330] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e205a454-9031-4fe4-88da-8cec8c028735',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.252588] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ceb1afc4-63ef-450a-b72c-5b79e8970a01 in Status: SUCCESS [ 649.252846] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ceb1afc4-63ef-450a-b72c-5b79e8970a01 deletion is rescheduled due to dependency. [ 649.252994] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ceb1afc4-63ef-450a-b72c-5b79e8970a01" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.418663] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.418663] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.418663] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.419278] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.419278] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.419278] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Segment Port 97610c64-962a-41f4-bc35-6a8b748710d2 not found, creating... [ 649.419645] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.419760] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.419871] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.421798] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.422236] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.422960] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.423151] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.423267] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.423659] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.423659] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.423764] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Resource: SegmentPort with ID: 97610c64-962a-41f4-bc35-6a8b748710d2 is going to be created. [ 649.448371] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.448491] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.448531] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.448881] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.449099] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.449360] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "port-97610c64-962a-41f4-bc35-6a8b748710d2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.467412] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e205a454-9031-4fe4-88da-8cec8c028735 [ 649.467412] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.468131] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.468131] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.468131] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.468131] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.468131] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e205a454-9031-4fe4-88da-8cec8c028735 already deleted. [ 649.468131] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e205a454-9031-4fe4-88da-8cec8c028735" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.942479] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 453acdc6-7d50-452b-bb4b-66af12a7624a in Status: SUCCESS [ 649.942732] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-453acdc6-7d50-452b-bb4b-66af12a7624a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.942829] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-453acdc6-7d50-452b-bb4b-66af12a7624a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.943108] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-453acdc6-7d50-452b-bb4b-66af12a7624a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.943287] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.943423] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.943506] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.943711] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.943802] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.943891] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-453acdc6-7d50-452b-bb4b-66af12a7624a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.944046] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('453acdc6-7d50-452b-bb4b-66af12a7624a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.161215] env[65471]: INFO networking_nsxv3.common.synchronization [req-cbc0c0a0-2781-4fbe-bcfd-9c3b7e834a56 req-20cb232b-3299-4950-b4cc-52c571546da9 service nova] Enqueued Resource ID: 49f0917b-c43e-421e-9ccf-fe8487bf2b37 with Priority: HIGHEST for action security_group_rules [ 650.161402] env[65471]: INFO networking_nsxv3.common.synchronization [req-cbc0c0a0-2781-4fbe-bcfd-9c3b7e834a56 req-20cb232b-3299-4950-b4cc-52c571546da9 service nova] Enqueued Resource ID: 49f0917b-c43e-421e-9ccf-fe8487bf2b37 with Priority: HIGHEST for action security_group_members [ 650.161535] env[65471]: INFO networking_nsxv3.common.synchronization [req-cbc0c0a0-2781-4fbe-bcfd-9c3b7e834a56 req-20cb232b-3299-4950-b4cc-52c571546da9 service nova] Enqueued Resource ID: 97610c64-962a-41f4-bc35-6a8b748710d2 with Priority: HIGHEST for action port [ 650.162060] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49f0917b-c43e-421e-9ccf-fe8487bf2b37 with Priority: HIGHEST for action security_group_rules [ 650.162198] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49f0917b-c43e-421e-9ccf-fe8487bf2b37 with Priority: HIGHEST for action security_group_members [ 650.162298] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97610c64-962a-41f4-bc35-6a8b748710d2 with Priority: HIGHEST for action port [ 650.162571] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49f0917b-c43e-421e-9ccf-fe8487bf2b37 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.162798] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49f0917b-c43e-421e-9ccf-fe8487bf2b37" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.162798] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49f0917b-c43e-421e-9ccf-fe8487bf2b37" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.163024] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49f0917b-c43e-421e-9ccf-fe8487bf2b37" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.163963] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49f0917b-c43e-421e-9ccf-fe8487bf2b37',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.170825] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-49f0917b-c43e-421e-9ccf-fe8487bf2b37 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.170825] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49f0917b-c43e-421e-9ccf-fe8487bf2b37" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.170825] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-97610c64-962a-41f4-bc35-6a8b748710d2 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.170825] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-97610c64-962a-41f4-bc35-6a8b748710d2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.170825] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-97610c64-962a-41f4-bc35-6a8b748710d2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.170825] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-97610c64-962a-41f4-bc35-6a8b748710d2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.170825] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97610c64-962a-41f4-bc35-6a8b748710d2',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.447275] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-453acdc6-7d50-452b-bb4b-66af12a7624a taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.447275] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-453acdc6-7d50-452b-bb4b-66af12a7624a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.447275] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-453acdc6-7d50-452b-bb4b-66af12a7624a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.447275] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-453acdc6-7d50-452b-bb4b-66af12a7624a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.447275] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.447275] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.447275] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.447664] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.447664] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.447664] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-453acdc6-7d50-452b-bb4b-66af12a7624a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.447664] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-453acdc6-7d50-452b-bb4b-66af12a7624a taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.447802] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-453acdc6-7d50-452b-bb4b-66af12a7624a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.447802] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-453acdc6-7d50-452b-bb4b-66af12a7624a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.449050] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-453acdc6-7d50-452b-bb4b-66af12a7624a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.449050] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.449050] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.449050] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.449050] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.449050] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.449050] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-453acdc6-7d50-452b-bb4b-66af12a7624a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.449050] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('453acdc6-7d50-452b-bb4b-66af12a7624a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.671471] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-49f0917b-c43e-421e-9ccf-fe8487bf2b37 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.671718] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49f0917b-c43e-421e-9ccf-fe8487bf2b37" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.676842] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 97610c64-962a-41f4-bc35-6a8b748710d2 with status ACTIVE [ 650.676842] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.676842] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.676842] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.676842] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.676842] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.676842] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.676842] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.676842] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.676842] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.676842] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.676842] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.676842] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.677511] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.677511] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.677511] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.677511] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 97610c64-962a-41f4-bc35-6a8b748710d2 is going to be updated. [ 650.701489] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.702398] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.702398] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.702398] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.702398] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.702398] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-97610c64-962a-41f4-bc35-6a8b748710d2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.738490] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49f0917b-c43e-421e-9ccf-fe8487bf2b37 in Status: SUCCESS [ 650.738681] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49f0917b-c43e-421e-9ccf-fe8487bf2b37 deletion is rescheduled due to dependency. [ 650.738795] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49f0917b-c43e-421e-9ccf-fe8487bf2b37" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.739150] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49f0917b-c43e-421e-9ccf-fe8487bf2b37" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.739225] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49f0917b-c43e-421e-9ccf-fe8487bf2b37" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.739511] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.739511] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.739682] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.739732] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.739840] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.741803] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49f0917b-c43e-421e-9ccf-fe8487bf2b37',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.824580] env[65471]: INFO networking_nsxv3.common.synchronization [None req-11c3dc58-e6c6-4a70-8511-f8aedfea17f8 None None] Enqueued Resource ID: 31047c66-0ec0-46fe-a32d-95f698e9195c with Priority: HIGHEST for action port [ 650.825324] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31047c66-0ec0-46fe-a32d-95f698e9195c with Priority: HIGHEST for action port [ 650.825722] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-31047c66-0ec0-46fe-a32d-95f698e9195c taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.825856] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31047c66-0ec0-46fe-a32d-95f698e9195c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.825921] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31047c66-0ec0-46fe-a32d-95f698e9195c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.826233] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31047c66-0ec0-46fe-a32d-95f698e9195c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.826361] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31047c66-0ec0-46fe-a32d-95f698e9195c',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.956028] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 453acdc6-7d50-452b-bb4b-66af12a7624a: rpc.has_security_group_logging(os_id): False [ 650.978965] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.978965] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.978965] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.978965] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.978965] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.980783] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.980920] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.981019] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.981264] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.981331] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.981487] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.983615] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.983615] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.983615] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.983615] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.983615] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.983615] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.983615] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.983615] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.983615] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.983615] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 453acdc6-7d50-452b-bb4b-66af12a7624a is going to be created. [ 651.063110] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.067979] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.067979] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.067979] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.067979] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.081053] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 453acdc6-7d50-452b-bb4b-66af12a7624a in Status: IN_PROGRESS for 2s [ 651.245342] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('49f0917b-c43e-421e-9ccf-fe8487bf2b37',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.332164] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 31047c66-0ec0-46fe-a32d-95f698e9195c [ 651.332164] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.332164] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.332164] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.332164] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.332164] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.332164] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:31047c66-0ec0-46fe-a32d-95f698e9195c already deleted. [ 651.332164] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31047c66-0ec0-46fe-a32d-95f698e9195c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.751505] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('49f0917b-c43e-421e-9ccf-fe8487bf2b37',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.055907] env[65471]: INFO networking_nsxv3.common.synchronization [None req-c409055b-ebda-4111-87c3-60d9554d4f2c tempest-ServerActionsTestOtherB-402089456 tempest-ServerActionsTestOtherB-402089456-project-member] Enqueued Resource ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 with Priority: HIGHEST for action security_group_rules [ 652.056669] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 with Priority: HIGHEST for action security_group_rules [ 652.056918] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b71ce0e0-83fe-4f36-8617-e29f83b0be32 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.058104] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.058327] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.058562] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.058661] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b71ce0e0-83fe-4f36-8617-e29f83b0be32',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.202109] env[65471]: INFO networking_nsxv3.common.synchronization [None req-4cc0baca-b040-423d-b7b0-39a1ea22a161 tempest-ServerActionsTestOtherB-402089456 tempest-ServerActionsTestOtherB-402089456-project-member] Enqueued Resource ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 with Priority: HIGHEST for action security_group_rules [ 652.202109] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 with Priority: HIGHEST for action security_group_rules [ 652.202109] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b71ce0e0-83fe-4f36-8617-e29f83b0be32 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.202109] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.255893] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.255893] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.255893] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.255893] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.255893] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.255893] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49f0917b-c43e-421e-9ccf-fe8487bf2b37 is going to be updated. [ 652.289336] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.289667] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.289774] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.290012] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.290660] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.302933] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49f0917b-c43e-421e-9ccf-fe8487bf2b37 in Status: IN_PROGRESS for 2s [ 652.585553] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.585553] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.585553] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.585553] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.585553] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.585553] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 already deleted. [ 652.585553] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.586122] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.586122] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.586237] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b71ce0e0-83fe-4f36-8617-e29f83b0be32',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.101787] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 453acdc6-7d50-452b-bb4b-66af12a7624a in Status: SUCCESS [ 653.102259] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-453acdc6-7d50-452b-bb4b-66af12a7624a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.113845] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.114053] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.114152] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.114405] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.114524] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.114644] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 already deleted. [ 653.114750] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.721079] env[65471]: INFO networking_nsxv3.common.synchronization [None req-a4ac1e5d-63fd-4de9-8fa5-25832678d025 None None] Enqueued Resource ID: 587c3e0b-5cc6-429a-9ad9-69bd53f24843 with Priority: HIGHEST for action port [ 653.721079] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 587c3e0b-5cc6-429a-9ad9-69bd53f24843 with Priority: HIGHEST for action port [ 653.721079] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-587c3e0b-5cc6-429a-9ad9-69bd53f24843 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.721079] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-587c3e0b-5cc6-429a-9ad9-69bd53f24843" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.721621] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-587c3e0b-5cc6-429a-9ad9-69bd53f24843" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.724046] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-587c3e0b-5cc6-429a-9ad9-69bd53f24843" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.724046] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('587c3e0b-5cc6-429a-9ad9-69bd53f24843',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.001554] env[65471]: INFO networking_nsxv3.common.synchronization [req-904c8dfd-e26f-454f-b41a-31039e129a6a req-37889ac8-146f-4cfa-bd2f-3f390497fe05 tempest-ServersWithSpecificFlavorTestJSON-1911677354 tempest-ServersWithSpecificFlavorTestJSON-1911677354-project-member] Enqueued Resource ID: 57387769-3919-42b1-a3d7-3d45bcef516d with Priority: HIGHEST for action security_group_members [ 654.001554] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57387769-3919-42b1-a3d7-3d45bcef516d with Priority: HIGHEST for action security_group_members [ 654.002166] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-57387769-3919-42b1-a3d7-3d45bcef516d taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.002166] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57387769-3919-42b1-a3d7-3d45bcef516d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.002166] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57387769-3919-42b1-a3d7-3d45bcef516d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.003765] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57387769-3919-42b1-a3d7-3d45bcef516d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.004091] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.004619] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.004619] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.004619] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.004903] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.004903] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57387769-3919-42b1-a3d7-3d45bcef516d',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.224772] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 587c3e0b-5cc6-429a-9ad9-69bd53f24843 [ 654.225111] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.225196] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.225248] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.225490] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.225596] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.225685] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:587c3e0b-5cc6-429a-9ad9-69bd53f24843 already deleted. [ 654.225801] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-587c3e0b-5cc6-429a-9ad9-69bd53f24843" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.316264] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49f0917b-c43e-421e-9ccf-fe8487bf2b37 in Status: SUCCESS [ 654.316264] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49f0917b-c43e-421e-9ccf-fe8487bf2b37" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.316264] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49f0917b-c43e-421e-9ccf-fe8487bf2b37" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.316397] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49f0917b-c43e-421e-9ccf-fe8487bf2b37" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.316684] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.316860] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.316940] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.317123] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.317310] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.317396] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49f0917b-c43e-421e-9ccf-fe8487bf2b37" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.317551] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('49f0917b-c43e-421e-9ccf-fe8487bf2b37',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.506571] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.506973] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.507186] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.507540] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.507766] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.508155] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.508895] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.508895] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.508895] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.508895] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.508895] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57387769-3919-42b1-a3d7-3d45bcef516d already deleted. [ 654.508895] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57387769-3919-42b1-a3d7-3d45bcef516d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.524894] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock network-310 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.525110] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "network-310" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.525231] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "network-310" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.525548] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "network-310" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.525809] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.526018] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.526162] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.526496] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.526613] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.526854] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 654.527009] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 654.527150] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 654.527280] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 654.527807] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 654.527807] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 654.527807] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 654.548656] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 654.548829] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 654.548942] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 654.549131] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "network-310" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.549493] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock port-5cd7aad9-d261-4247-acd8-733c9e9fbb4b taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.549674] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "port-5cd7aad9-d261-4247-acd8-733c9e9fbb4b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.549805] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "port-5cd7aad9-d261-4247-acd8-733c9e9fbb4b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.550411] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "port-5cd7aad9-d261-4247-acd8-733c9e9fbb4b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.550411] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5cd7aad9-d261-4247-acd8-733c9e9fbb4b',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.820720] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-49f0917b-c43e-421e-9ccf-fe8487bf2b37 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.820888] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49f0917b-c43e-421e-9ccf-fe8487bf2b37" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.820954] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49f0917b-c43e-421e-9ccf-fe8487bf2b37" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.821210] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49f0917b-c43e-421e-9ccf-fe8487bf2b37" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.821396] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.821503] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.821564] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.821718] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.821802] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.821891] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49f0917b-c43e-421e-9ccf-fe8487bf2b37" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.822052] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-49f0917b-c43e-421e-9ccf-fe8487bf2b37 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.822143] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49f0917b-c43e-421e-9ccf-fe8487bf2b37" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.822216] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49f0917b-c43e-421e-9ccf-fe8487bf2b37" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.822340] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49f0917b-c43e-421e-9ccf-fe8487bf2b37" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.822529] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.822623] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.822623] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.822786] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.822886] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.822936] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49f0917b-c43e-421e-9ccf-fe8487bf2b37" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.823033] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('49f0917b-c43e-421e-9ccf-fe8487bf2b37',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.055424] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.055424] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.056271] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.056271] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.056271] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.056515] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Segment Port 5cd7aad9-d261-4247-acd8-733c9e9fbb4b not found, creating... [ 655.056853] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.057117] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.057440] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.057674] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.057884] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.058788] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.058788] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.058788] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.058997] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.059181] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.059341] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Resource: SegmentPort with ID: 5cd7aad9-d261-4247-acd8-733c9e9fbb4b is going to be created. [ 655.080629] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.080794] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.080907] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.081217] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.081460] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.081717] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "port-5cd7aad9-d261-4247-acd8-733c9e9fbb4b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.326346] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 49f0917b-c43e-421e-9ccf-fe8487bf2b37: rpc.has_security_group_logging(os_id): False [ 655.347927] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.348108] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.348108] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.348792] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.348792] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.348792] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.348792] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.348995] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.348995] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.349086] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.349284] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.349442] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.349513] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.349666] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.349739] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.349973] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.350283] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.350382] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.350682] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.353020] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.353020] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49f0917b-c43e-421e-9ccf-fe8487bf2b37 is going to be updated. [ 655.415899] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.416474] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.416556] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.416859] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.417039] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.430769] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49f0917b-c43e-421e-9ccf-fe8487bf2b37 in Status: IN_PROGRESS for 2s [ 655.884564] env[65471]: INFO networking_nsxv3.common.synchronization [req-904c8dfd-e26f-454f-b41a-31039e129a6a req-1ebef785-ffbd-406a-b38c-241fb996ece6 service nova] Enqueued Resource ID: 57387769-3919-42b1-a3d7-3d45bcef516d with Priority: HIGHEST for action security_group_rules [ 655.884954] env[65471]: INFO networking_nsxv3.common.synchronization [req-904c8dfd-e26f-454f-b41a-31039e129a6a req-1ebef785-ffbd-406a-b38c-241fb996ece6 service nova] Enqueued Resource ID: 57387769-3919-42b1-a3d7-3d45bcef516d with Priority: HIGHEST for action security_group_members [ 655.885493] env[65471]: INFO networking_nsxv3.common.synchronization [req-904c8dfd-e26f-454f-b41a-31039e129a6a req-1ebef785-ffbd-406a-b38c-241fb996ece6 service nova] Enqueued Resource ID: 5cd7aad9-d261-4247-acd8-733c9e9fbb4b with Priority: HIGHEST for action port [ 655.886370] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57387769-3919-42b1-a3d7-3d45bcef516d with Priority: HIGHEST for action security_group_rules [ 655.886672] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57387769-3919-42b1-a3d7-3d45bcef516d with Priority: HIGHEST for action security_group_members [ 655.886925] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5cd7aad9-d261-4247-acd8-733c9e9fbb4b with Priority: HIGHEST for action port [ 655.889954] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57387769-3919-42b1-a3d7-3d45bcef516d taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.892032] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57387769-3919-42b1-a3d7-3d45bcef516d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.892032] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57387769-3919-42b1-a3d7-3d45bcef516d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.892032] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57387769-3919-42b1-a3d7-3d45bcef516d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.892032] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57387769-3919-42b1-a3d7-3d45bcef516d',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.892032] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-57387769-3919-42b1-a3d7-3d45bcef516d taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.892032] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57387769-3919-42b1-a3d7-3d45bcef516d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.892032] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57387769-3919-42b1-a3d7-3d45bcef516d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.892032] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57387769-3919-42b1-a3d7-3d45bcef516d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.893045] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.893045] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.893045] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.893045] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.893045] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.893045] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57387769-3919-42b1-a3d7-3d45bcef516d',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.897599] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-5cd7aad9-d261-4247-acd8-733c9e9fbb4b taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.897599] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5cd7aad9-d261-4247-acd8-733c9e9fbb4b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.897599] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5cd7aad9-d261-4247-acd8-733c9e9fbb4b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.897599] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5cd7aad9-d261-4247-acd8-733c9e9fbb4b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.897599] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5cd7aad9-d261-4247-acd8-733c9e9fbb4b',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.222395] env[65471]: INFO networking_nsxv3.common.synchronization [req-d87d4179-73e9-45e4-946a-e8c383328285 req-d9637076-55da-49dd-b2d0-64bfb82c8747 tempest-ServersAdminTestJSON-1197360877 tempest-ServersAdminTestJSON-1197360877-project-member] Enqueued Resource ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 with Priority: HIGHEST for action security_group_members [ 656.223170] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 with Priority: HIGHEST for action security_group_members [ 656.224710] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4ca8456-5b21-4080-b762-7b52a4837eb1 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.224895] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.225068] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.225165] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.225335] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.225438] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.225502] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.225681] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.225778] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.225881] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4ca8456-5b21-4080-b762-7b52a4837eb1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.397090] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57387769-3919-42b1-a3d7-3d45bcef516d',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.397685] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-57387769-3919-42b1-a3d7-3d45bcef516d taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.397685] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57387769-3919-42b1-a3d7-3d45bcef516d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.397991] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5cd7aad9-d261-4247-acd8-733c9e9fbb4b with status ACTIVE [ 656.398179] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.398316] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.398380] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.399957] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.399957] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.399957] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.399957] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.399957] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.400303] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.400303] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.400703] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.400703] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.400703] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.401288] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.401643] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.401643] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5cd7aad9-d261-4247-acd8-733c9e9fbb4b is going to be updated. [ 656.428342] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.428483] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.428553] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.429162] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.429463] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.429574] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5cd7aad9-d261-4247-acd8-733c9e9fbb4b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.608732] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock network-593 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.609615] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "network-593" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.609615] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "network-593" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.609615] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "network-593" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.609784] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.609940] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.610040] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.610306] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.610487] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.610734] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 656.610806] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 656.610909] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 656.611028] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 656.611211] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 656.611266] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 656.611346] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 656.634771] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 656.635320] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 656.635320] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 656.635320] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "network-593" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.635579] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock port-41247087-1959-42c2-804b-e04f748031f8 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.635743] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "port-41247087-1959-42c2-804b-e04f748031f8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.635855] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "port-41247087-1959-42c2-804b-e04f748031f8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.636197] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "port-41247087-1959-42c2-804b-e04f748031f8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.636331] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41247087-1959-42c2-804b-e04f748031f8',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.729154] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e4ca8456-5b21-4080-b762-7b52a4837eb1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.899281] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57387769-3919-42b1-a3d7-3d45bcef516d',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.138511] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.139255] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.139255] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.139374] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.139821] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.139821] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Segment Port 41247087-1959-42c2-804b-e04f748031f8 not found, creating... [ 657.140011] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.140186] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.140299] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.140568] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.140714] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.141151] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.141242] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.141375] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.141549] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.141686] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.141817] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Resource: SegmentPort with ID: 41247087-1959-42c2-804b-e04f748031f8 is going to be created. [ 657.163187] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.163327] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.163435] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.163716] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.163944] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.164171] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "port-41247087-1959-42c2-804b-e04f748031f8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.231760] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e4ca8456-5b21-4080-b762-7b52a4837eb1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.403062] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.403062] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.403062] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.403540] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.403540] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.403769] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57387769-3919-42b1-a3d7-3d45bcef516d is going to be created. [ 657.432567] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.432719] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.432769] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.433168] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.433341] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.444015] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57387769-3919-42b1-a3d7-3d45bcef516d in Status: UNINITIALIZED for 2s [ 657.446906] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49f0917b-c43e-421e-9ccf-fe8487bf2b37 in Status: SUCCESS [ 657.447474] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49f0917b-c43e-421e-9ccf-fe8487bf2b37" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.733763] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.733925] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.734074] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.734721] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.735173] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.735173] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 is going to be updated. [ 657.763469] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.763760] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.763760] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.763889] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.764014] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.773892] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 in Status: IN_PROGRESS for 2s [ 657.865656] env[65471]: INFO networking_nsxv3.common.synchronization [req-d87d4179-73e9-45e4-946a-e8c383328285 req-ea245e01-d166-4e69-bcb6-53bdaa81c795 service nova] Enqueued Resource ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 with Priority: HIGHEST for action security_group_rules [ 657.865844] env[65471]: INFO networking_nsxv3.common.synchronization [req-d87d4179-73e9-45e4-946a-e8c383328285 req-ea245e01-d166-4e69-bcb6-53bdaa81c795 service nova] Enqueued Resource ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 with Priority: HIGHEST for action security_group_members [ 657.865974] env[65471]: INFO networking_nsxv3.common.synchronization [req-d87d4179-73e9-45e4-946a-e8c383328285 req-ea245e01-d166-4e69-bcb6-53bdaa81c795 service nova] Enqueued Resource ID: 41247087-1959-42c2-804b-e04f748031f8 with Priority: HIGHEST for action port [ 657.866617] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 with Priority: HIGHEST for action security_group_rules [ 657.866806] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 with Priority: HIGHEST for action security_group_members [ 657.866984] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41247087-1959-42c2-804b-e04f748031f8 with Priority: HIGHEST for action port [ 657.867400] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e4ca8456-5b21-4080-b762-7b52a4837eb1 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.867540] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.867608] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.867857] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.867962] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e4ca8456-5b21-4080-b762-7b52a4837eb1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.868934] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4ca8456-5b21-4080-b762-7b52a4837eb1 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.869911] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.870892] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-41247087-1959-42c2-804b-e04f748031f8 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.871043] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-41247087-1959-42c2-804b-e04f748031f8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.871165] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-41247087-1959-42c2-804b-e04f748031f8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.871298] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-41247087-1959-42c2-804b-e04f748031f8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.871378] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41247087-1959-42c2-804b-e04f748031f8',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.375288] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4ca8456-5b21-4080-b762-7b52a4837eb1 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.375420] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.375623] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 41247087-1959-42c2-804b-e04f748031f8 with status ACTIVE [ 658.375797] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.375901] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.375987] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.376187] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.377096] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.377096] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.377096] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.377096] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.377096] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.377096] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.377096] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.377096] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.377096] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.377684] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.377684] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.377684] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 41247087-1959-42c2-804b-e04f748031f8 is going to be updated. [ 658.399493] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.399661] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.399739] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.400305] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.400305] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.400305] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-41247087-1959-42c2-804b-e04f748031f8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.173384] env[65471]: INFO networking_nsxv3.common.synchronization [None req-fed789d9-6d25-4cb7-89cc-5fd29319fc08 None None] Enqueued Resource ID: 35dedd9c-7689-44fa-9a17-5ae61487d215 with Priority: HIGHEST for action port [ 659.173953] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35dedd9c-7689-44fa-9a17-5ae61487d215 with Priority: HIGHEST for action port [ 659.174641] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-35dedd9c-7689-44fa-9a17-5ae61487d215 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.174641] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-35dedd9c-7689-44fa-9a17-5ae61487d215" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.174822] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-35dedd9c-7689-44fa-9a17-5ae61487d215" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.174946] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-35dedd9c-7689-44fa-9a17-5ae61487d215" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.175191] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35dedd9c-7689-44fa-9a17-5ae61487d215',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.191091] env[65471]: INFO networking_nsxv3.common.synchronization [req-1c93fe75-5663-47d4-a95e-6d09e1fd97af req-307fa478-aa90-4d5d-bdc4-93e16148f2f1 tempest-InstanceActionsTestJSON-1692996391 tempest-InstanceActionsTestJSON-1692996391-project-member] Enqueued Resource ID: 44e07836-d56c-494a-9b74-978c8fd6933f with Priority: HIGHEST for action security_group_members [ 659.191913] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44e07836-d56c-494a-9b74-978c8fd6933f with Priority: HIGHEST for action security_group_members [ 659.192576] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-44e07836-d56c-494a-9b74-978c8fd6933f taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.192576] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44e07836-d56c-494a-9b74-978c8fd6933f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.192576] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44e07836-d56c-494a-9b74-978c8fd6933f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.192718] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44e07836-d56c-494a-9b74-978c8fd6933f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.192864] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.193073] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.193073] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.193249] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.193338] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.193431] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44e07836-d56c-494a-9b74-978c8fd6933f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.419183] env[65471]: INFO networking_nsxv3.common.synchronization [None req-506390be-7cb5-4870-b60c-248212b0932d None None] Enqueued Resource ID: d7ae9862-5f7a-423b-bfec-83c2afb3c9a2 with Priority: HIGHEST for action port [ 659.419764] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7ae9862-5f7a-423b-bfec-83c2afb3c9a2 with Priority: HIGHEST for action port [ 659.420096] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7ae9862-5f7a-423b-bfec-83c2afb3c9a2 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.420252] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7ae9862-5f7a-423b-bfec-83c2afb3c9a2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.420298] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7ae9862-5f7a-423b-bfec-83c2afb3c9a2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.420606] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7ae9862-5f7a-423b-bfec-83c2afb3c9a2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.420709] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7ae9862-5f7a-423b-bfec-83c2afb3c9a2',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.453726] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57387769-3919-42b1-a3d7-3d45bcef516d in Status: SUCCESS [ 659.453944] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57387769-3919-42b1-a3d7-3d45bcef516d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.454121] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57387769-3919-42b1-a3d7-3d45bcef516d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.454344] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57387769-3919-42b1-a3d7-3d45bcef516d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.455012] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.455533] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.455533] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.455533] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.455533] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.455731] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57387769-3919-42b1-a3d7-3d45bcef516d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.455731] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('57387769-3919-42b1-a3d7-3d45bcef516d',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.615796] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock network-840 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.616037] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "network-840" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.616188] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "network-840" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.616450] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "network-840" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.616748] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.616907] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.617037] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.617270] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.617426] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.617626] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 659.617730] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 659.617831] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 659.617932] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 659.618055] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 659.618157] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 659.618282] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 659.636810] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 659.637015] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 659.637152] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 659.637323] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "network-840" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.637645] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock port-7cfbf134-511b-4f6e-bc1e-bd6bdf215abd taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.637835] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "port-7cfbf134-511b-4f6e-bc1e-bd6bdf215abd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.637949] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "port-7cfbf134-511b-4f6e-bc1e-bd6bdf215abd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.638279] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "port-7cfbf134-511b-4f6e-bc1e-bd6bdf215abd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.638411] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7cfbf134-511b-4f6e-bc1e-bd6bdf215abd',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.678567] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 35dedd9c-7689-44fa-9a17-5ae61487d215 [ 659.678567] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.678567] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.678567] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.678567] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.678567] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.678567] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:35dedd9c-7689-44fa-9a17-5ae61487d215 already deleted. [ 659.678567] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-35dedd9c-7689-44fa-9a17-5ae61487d215" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.696302] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.696506] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.696560] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.696732] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.696824] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.697040] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.697145] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.697208] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.697367] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.697445] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.697530] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44e07836-d56c-494a-9b74-978c8fd6933f already deleted. [ 659.697691] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44e07836-d56c-494a-9b74-978c8fd6933f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.784678] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 in Status: SUCCESS [ 659.785328] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.785518] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.785734] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.785930] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.786056] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.786124] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.786285] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.786367] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.786464] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4ca8456-5b21-4080-b762-7b52a4837eb1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.923388] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d7ae9862-5f7a-423b-bfec-83c2afb3c9a2 [ 659.923621] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.923753] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.923902] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.924065] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.924140] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.924237] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d7ae9862-5f7a-423b-bfec-83c2afb3c9a2 already deleted. [ 659.924319] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7ae9862-5f7a-423b-bfec-83c2afb3c9a2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.961760] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('57387769-3919-42b1-a3d7-3d45bcef516d',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.141543] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.145021] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.145021] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.145021] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.145021] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.145021] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Segment Port 7cfbf134-511b-4f6e-bc1e-bd6bdf215abd not found, creating... [ 660.145021] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.145021] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.145021] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.145021] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.145021] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.145499] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.145499] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.145499] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.145499] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.145499] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.145499] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Resource: SegmentPort with ID: 7cfbf134-511b-4f6e-bc1e-bd6bdf215abd is going to be created. [ 660.169716] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.169983] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.170139] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.170454] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.170701] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.170930] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "port-7cfbf134-511b-4f6e-bc1e-bd6bdf215abd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.288950] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e4ca8456-5b21-4080-b762-7b52a4837eb1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.463413] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 57387769-3919-42b1-a3d7-3d45bcef516d: rpc.has_security_group_logging(os_id): False [ 660.481892] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.483122] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.483122] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.483122] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.483122] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.483122] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.483122] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.483122] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.483122] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.483122] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.483584] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57387769-3919-42b1-a3d7-3d45bcef516d is going to be created. [ 660.552393] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.552393] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.552393] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.552393] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.552393] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.568061] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57387769-3919-42b1-a3d7-3d45bcef516d in Status: IN_PROGRESS for 2s [ 660.793851] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e4ca8456-5b21-4080-b762-7b52a4837eb1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.056959] env[65471]: INFO networking_nsxv3.common.synchronization [req-1c93fe75-5663-47d4-a95e-6d09e1fd97af req-d9892872-7840-4335-9157-c633f140ee5a service nova] Enqueued Resource ID: 44e07836-d56c-494a-9b74-978c8fd6933f with Priority: HIGHEST for action security_group_rules [ 661.056959] env[65471]: INFO networking_nsxv3.common.synchronization [req-1c93fe75-5663-47d4-a95e-6d09e1fd97af req-d9892872-7840-4335-9157-c633f140ee5a service nova] Enqueued Resource ID: 44e07836-d56c-494a-9b74-978c8fd6933f with Priority: HIGHEST for action security_group_members [ 661.056959] env[65471]: INFO networking_nsxv3.common.synchronization [req-1c93fe75-5663-47d4-a95e-6d09e1fd97af req-d9892872-7840-4335-9157-c633f140ee5a service nova] Enqueued Resource ID: 7cfbf134-511b-4f6e-bc1e-bd6bdf215abd with Priority: HIGHEST for action port [ 661.056959] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44e07836-d56c-494a-9b74-978c8fd6933f with Priority: HIGHEST for action security_group_rules [ 661.056959] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44e07836-d56c-494a-9b74-978c8fd6933f with Priority: HIGHEST for action security_group_members [ 661.056959] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cfbf134-511b-4f6e-bc1e-bd6bdf215abd with Priority: HIGHEST for action port [ 661.059672] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-44e07836-d56c-494a-9b74-978c8fd6933f taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.059672] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-44e07836-d56c-494a-9b74-978c8fd6933f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.059923] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-44e07836-d56c-494a-9b74-978c8fd6933f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.059974] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-44e07836-d56c-494a-9b74-978c8fd6933f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.060055] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('44e07836-d56c-494a-9b74-978c8fd6933f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.061065] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-44e07836-d56c-494a-9b74-978c8fd6933f taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.061169] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44e07836-d56c-494a-9b74-978c8fd6933f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.061870] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44e07836-d56c-494a-9b74-978c8fd6933f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.061947] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44e07836-d56c-494a-9b74-978c8fd6933f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.062914] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.062914] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.062914] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.062914] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.062914] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.062914] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44e07836-d56c-494a-9b74-978c8fd6933f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.065618] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-7cfbf134-511b-4f6e-bc1e-bd6bdf215abd taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.065618] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7cfbf134-511b-4f6e-bc1e-bd6bdf215abd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.065618] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7cfbf134-511b-4f6e-bc1e-bd6bdf215abd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.065618] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7cfbf134-511b-4f6e-bc1e-bd6bdf215abd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.065618] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7cfbf134-511b-4f6e-bc1e-bd6bdf215abd',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.299114] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.299114] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.299114] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.299508] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.299508] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.299508] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 is going to be updated. [ 661.338107] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.338303] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.338366] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.338547] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.338700] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.352133] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 in Status: IN_PROGRESS for 2s [ 661.567809] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7cfbf134-511b-4f6e-bc1e-bd6bdf215abd with status ACTIVE [ 661.568059] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.568201] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.568263] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.568471] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.568556] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.568729] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.568823] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.568881] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.569034] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.569107] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.569278] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.569363] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.569414] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.569631] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.569703] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.569784] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7cfbf134-511b-4f6e-bc1e-bd6bdf215abd is going to be updated. [ 661.571675] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-44e07836-d56c-494a-9b74-978c8fd6933f taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.571898] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44e07836-d56c-494a-9b74-978c8fd6933f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.572266] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('44e07836-d56c-494a-9b74-978c8fd6933f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.598503] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.598691] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.598863] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.598897] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.599155] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.602831] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7cfbf134-511b-4f6e-bc1e-bd6bdf215abd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.075867] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('44e07836-d56c-494a-9b74-978c8fd6933f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.089230] env[65471]: INFO networking_nsxv3.common.synchronization [None req-d4fabe46-4b46-48dd-9d7e-cb2ded34c37f None None] Enqueued Resource ID: 7036a599-a4ac-4b14-bd7f-b387f96f9019 with Priority: HIGHEST for action port [ 662.090134] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7036a599-a4ac-4b14-bd7f-b387f96f9019 with Priority: HIGHEST for action port [ 662.091401] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-7036a599-a4ac-4b14-bd7f-b387f96f9019 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.091401] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7036a599-a4ac-4b14-bd7f-b387f96f9019" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.091401] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7036a599-a4ac-4b14-bd7f-b387f96f9019" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.091958] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7036a599-a4ac-4b14-bd7f-b387f96f9019" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.091958] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7036a599-a4ac-4b14-bd7f-b387f96f9019',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.409267] env[65471]: INFO networking_nsxv3.common.synchronization [None req-bcfc5450-2086-4d39-99dc-ef21560a71d7 None None] Enqueued Resource ID: 073e4c61-438f-403e-91fc-09e6575709c7 with Priority: HIGHEST for action port [ 662.409267] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 073e4c61-438f-403e-91fc-09e6575709c7 with Priority: HIGHEST for action port [ 662.409746] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-073e4c61-438f-403e-91fc-09e6575709c7 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.409746] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-073e4c61-438f-403e-91fc-09e6575709c7" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.409746] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-073e4c61-438f-403e-91fc-09e6575709c7" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.409963] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-073e4c61-438f-403e-91fc-09e6575709c7" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.409963] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('073e4c61-438f-403e-91fc-09e6575709c7',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.579641] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.579822] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.579878] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.580234] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.580234] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.580403] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44e07836-d56c-494a-9b74-978c8fd6933f is going to be created. [ 662.587616] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57387769-3919-42b1-a3d7-3d45bcef516d in Status: SUCCESS [ 662.587853] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57387769-3919-42b1-a3d7-3d45bcef516d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.598599] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7036a599-a4ac-4b14-bd7f-b387f96f9019 [ 662.598599] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.598599] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.598599] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.598599] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.598599] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.598599] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7036a599-a4ac-4b14-bd7f-b387f96f9019 already deleted. [ 662.598599] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7036a599-a4ac-4b14-bd7f-b387f96f9019" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.608431] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.608431] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.608431] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.608431] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.608431] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.621151] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44e07836-d56c-494a-9b74-978c8fd6933f in Status: UNINITIALIZED for 2s [ 662.737069] env[65471]: INFO networking_nsxv3.common.synchronization [None req-a5dc6ce0-45c5-4a45-b1a2-936eef431b2a tempest-ServersTestJSON-2129330820 tempest-ServersTestJSON-2129330820-project-member] Enqueued Resource ID: 9164de2f-6b7d-4419-aa70-d088a6c9ab9f with Priority: HIGHEST for action security_group_rules [ 662.737069] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9164de2f-6b7d-4419-aa70-d088a6c9ab9f with Priority: HIGHEST for action security_group_rules [ 662.737069] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9164de2f-6b7d-4419-aa70-d088a6c9ab9f taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.737069] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9164de2f-6b7d-4419-aa70-d088a6c9ab9f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.737069] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9164de2f-6b7d-4419-aa70-d088a6c9ab9f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.737069] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9164de2f-6b7d-4419-aa70-d088a6c9ab9f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.738119] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9164de2f-6b7d-4419-aa70-d088a6c9ab9f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.819365] env[65471]: INFO networking_nsxv3.common.synchronization [None req-90162b10-07ca-4be4-b3a3-28edd68a0e06 tempest-ServersTestJSON-2129330820 tempest-ServersTestJSON-2129330820-project-member] Enqueued Resource ID: 9164de2f-6b7d-4419-aa70-d088a6c9ab9f with Priority: HIGHEST for action security_group_rules [ 662.819365] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9164de2f-6b7d-4419-aa70-d088a6c9ab9f with Priority: HIGHEST for action security_group_rules [ 662.819365] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9164de2f-6b7d-4419-aa70-d088a6c9ab9f taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.819365] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9164de2f-6b7d-4419-aa70-d088a6c9ab9f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.915403] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 073e4c61-438f-403e-91fc-09e6575709c7 [ 662.915689] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.915824] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.915901] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.916131] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.916224] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.916317] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:073e4c61-438f-403e-91fc-09e6575709c7 already deleted. [ 662.916399] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-073e4c61-438f-403e-91fc-09e6575709c7" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.268211] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.268211] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.268211] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.268211] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.268211] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.268211] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9164de2f-6b7d-4419-aa70-d088a6c9ab9f already deleted. [ 663.268211] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9164de2f-6b7d-4419-aa70-d088a6c9ab9f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.269018] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9164de2f-6b7d-4419-aa70-d088a6c9ab9f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.269018] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9164de2f-6b7d-4419-aa70-d088a6c9ab9f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.269018] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9164de2f-6b7d-4419-aa70-d088a6c9ab9f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.373875] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 in Status: SUCCESS [ 663.373987] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.374621] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.374862] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.375243] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.375243] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.375369] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.377283] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.377283] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.377283] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.377283] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e4ca8456-5b21-4080-b762-7b52a4837eb1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.801500] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.801500] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.801500] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.801500] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.801500] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.801500] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9164de2f-6b7d-4419-aa70-d088a6c9ab9f already deleted. [ 663.801500] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9164de2f-6b7d-4419-aa70-d088a6c9ab9f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.881360] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4ca8456-5b21-4080-b762-7b52a4837eb1 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.881360] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.881360] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.881360] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.881360] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.881360] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.881360] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.881360] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.881360] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.881360] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.881360] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4ca8456-5b21-4080-b762-7b52a4837eb1 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.881360] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.881360] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.881360] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.881360] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.881360] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.881981] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.881981] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.881981] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.881981] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.881981] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e4ca8456-5b21-4080-b762-7b52a4837eb1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.384386] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e4ca8456-5b21-4080-b762-7b52a4837eb1: rpc.has_security_group_logging(os_id): False [ 664.410150] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.410371] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.410371] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.410657] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.410759] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.410981] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.411218] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.411218] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.411362] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.411416] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.411549] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.411646] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.411699] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.411844] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.411913] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.412121] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.412235] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.412300] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.412445] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.412519] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.412605] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 is going to be updated. [ 664.483474] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.483794] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.483794] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.483794] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.484043] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.500162] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 in Status: IN_PROGRESS for 2s [ 664.544211] env[65471]: INFO networking_nsxv3.common.synchronization [req-b3d8162c-01b1-49b7-99ba-1b1fd2817977 req-ed2f65b8-612a-4cf6-bd90-137fe23a8092 tempest-VolumesAdminNegativeTest-396097261 tempest-VolumesAdminNegativeTest-396097261-project-member] Enqueued Resource ID: b04574ca-6910-4de6-a76c-d7d90c7e2e0c with Priority: HIGHEST for action security_group_members [ 664.544211] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b04574ca-6910-4de6-a76c-d7d90c7e2e0c with Priority: HIGHEST for action security_group_members [ 664.544488] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-b04574ca-6910-4de6-a76c-d7d90c7e2e0c taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.544610] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b04574ca-6910-4de6-a76c-d7d90c7e2e0c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.544676] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b04574ca-6910-4de6-a76c-d7d90c7e2e0c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.544876] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b04574ca-6910-4de6-a76c-d7d90c7e2e0c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.545046] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.545143] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.545203] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.545349] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.545431] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.545532] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b04574ca-6910-4de6-a76c-d7d90c7e2e0c',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.638826] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44e07836-d56c-494a-9b74-978c8fd6933f in Status: SUCCESS [ 664.639115] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44e07836-d56c-494a-9b74-978c8fd6933f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.639424] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44e07836-d56c-494a-9b74-978c8fd6933f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.639667] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44e07836-d56c-494a-9b74-978c8fd6933f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.639924] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.640223] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.640223] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.640398] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.640481] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.641575] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44e07836-d56c-494a-9b74-978c8fd6933f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.641575] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('44e07836-d56c-494a-9b74-978c8fd6933f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.051067] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.051370] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.051370] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.052065] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.052579] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.052990] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.053103] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.053150] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.053404] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.053748] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.053748] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b04574ca-6910-4de6-a76c-d7d90c7e2e0c is going to be updated. [ 665.088699] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.088699] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.088699] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.088699] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.088699] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.103614] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b04574ca-6910-4de6-a76c-d7d90c7e2e0c in Status: IN_PROGRESS for 2s [ 665.146307] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-44e07836-d56c-494a-9b74-978c8fd6933f taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.146475] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44e07836-d56c-494a-9b74-978c8fd6933f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.146562] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44e07836-d56c-494a-9b74-978c8fd6933f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.146815] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44e07836-d56c-494a-9b74-978c8fd6933f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.146988] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.147104] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.147168] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.147346] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.147463] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.147569] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44e07836-d56c-494a-9b74-978c8fd6933f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.147728] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-44e07836-d56c-494a-9b74-978c8fd6933f taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.147816] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44e07836-d56c-494a-9b74-978c8fd6933f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.147875] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44e07836-d56c-494a-9b74-978c8fd6933f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.148269] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44e07836-d56c-494a-9b74-978c8fd6933f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.148269] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.148269] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.148775] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.148775] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.148775] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.148775] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44e07836-d56c-494a-9b74-978c8fd6933f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.148775] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('44e07836-d56c-494a-9b74-978c8fd6933f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.651284] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 44e07836-d56c-494a-9b74-978c8fd6933f: rpc.has_security_group_logging(os_id): False [ 665.673569] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.673848] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.673993] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.674347] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.674501] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.674909] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.677056] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.677056] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.677056] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.677290] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.677962] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.678481] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.678588] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.679244] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.679421] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.679792] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.679983] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.680121] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.680321] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.680432] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.681456] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 44e07836-d56c-494a-9b74-978c8fd6933f is going to be created. [ 665.719171] env[65471]: INFO networking_nsxv3.common.synchronization [None req-92022d51-f943-42da-8a32-30b21efd91dd None None] Enqueued Resource ID: a7e32260-2c8f-4030-90b6-6426446c5231 with Priority: HIGHEST for action port [ 665.720068] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7e32260-2c8f-4030-90b6-6426446c5231 with Priority: HIGHEST for action port [ 665.720743] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-a7e32260-2c8f-4030-90b6-6426446c5231 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.720874] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a7e32260-2c8f-4030-90b6-6426446c5231" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.721042] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a7e32260-2c8f-4030-90b6-6426446c5231" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.721412] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a7e32260-2c8f-4030-90b6-6426446c5231" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.721556] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7e32260-2c8f-4030-90b6-6426446c5231',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.760102] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.760318] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.760318] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.760681] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.760903] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.778476] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 44e07836-d56c-494a-9b74-978c8fd6933f in Status: IN_PROGRESS for 2s [ 666.223707] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a7e32260-2c8f-4030-90b6-6426446c5231 [ 666.224054] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.224156] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.224241] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.224470] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.224567] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.224676] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a7e32260-2c8f-4030-90b6-6426446c5231 already deleted. [ 666.224750] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a7e32260-2c8f-4030-90b6-6426446c5231" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.531327] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 in Status: SUCCESS [ 666.531411] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.563343] env[65471]: INFO networking_nsxv3.common.synchronization [req-55fe5d0a-1da4-4773-b826-eee0873ab0dd req-f90d4ffc-2172-4af1-a558-35012896f855 tempest-FloatingIPsAssociationTestJSON-777761534 tempest-FloatingIPsAssociationTestJSON-777761534-project-member] Enqueued Resource ID: fc157df5-294c-4a29-82ae-e1ec842611f3 with Priority: HIGHEST for action security_group_members [ 666.563497] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc157df5-294c-4a29-82ae-e1ec842611f3 with Priority: HIGHEST for action security_group_members [ 666.564162] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc157df5-294c-4a29-82ae-e1ec842611f3 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.564162] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc157df5-294c-4a29-82ae-e1ec842611f3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.564162] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc157df5-294c-4a29-82ae-e1ec842611f3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.565234] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc157df5-294c-4a29-82ae-e1ec842611f3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.565234] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.565234] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.565234] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.565234] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.565234] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.565234] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc157df5-294c-4a29-82ae-e1ec842611f3',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.070603] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.070822] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.070882] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.071164] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.071266] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.071497] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.071630] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.071696] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.071901] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.071986] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.072111] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc157df5-294c-4a29-82ae-e1ec842611f3 already deleted. [ 667.072199] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc157df5-294c-4a29-82ae-e1ec842611f3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.117761] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b04574ca-6910-4de6-a76c-d7d90c7e2e0c in Status: SUCCESS [ 667.118186] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b04574ca-6910-4de6-a76c-d7d90c7e2e0c deletion is rescheduled due to dependency. [ 667.118186] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b04574ca-6910-4de6-a76c-d7d90c7e2e0c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.383577] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock network-246 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.383929] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "network-246" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.383929] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "network-246" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.384460] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "network-246" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.384460] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.384604] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.384693] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.384903] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.385226] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.385619] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 667.385619] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 667.385723] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 667.385765] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 667.386014] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 667.386014] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 667.386114] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 667.408043] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 667.408043] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 667.408043] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 667.408354] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "network-246" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.408462] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock port-c2da4160-0320-4461-8854-f5dd78c63a26 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.408650] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "port-c2da4160-0320-4461-8854-f5dd78c63a26" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.408771] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "port-c2da4160-0320-4461-8854-f5dd78c63a26" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.409121] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "port-c2da4160-0320-4461-8854-f5dd78c63a26" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.409269] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2da4160-0320-4461-8854-f5dd78c63a26',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.792146] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 44e07836-d56c-494a-9b74-978c8fd6933f in Status: SUCCESS [ 667.792146] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-44e07836-d56c-494a-9b74-978c8fd6933f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.912106] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.912396] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.912545] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.912840] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.912994] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.913169] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Segment Port c2da4160-0320-4461-8854-f5dd78c63a26 not found, creating... [ 667.913465] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.916456] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.916456] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.916456] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.916456] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.916456] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.916456] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.916456] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.916456] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.916456] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.916456] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Resource: SegmentPort with ID: c2da4160-0320-4461-8854-f5dd78c63a26 is going to be created. [ 667.940656] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.940935] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.941124] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.941420] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.941644] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.941919] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "port-c2da4160-0320-4461-8854-f5dd78c63a26" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.241930] env[65471]: INFO networking_nsxv3.common.synchronization [None req-c930d8b9-48f9-4a42-877d-7c79862bd22b None None] Enqueued Resource ID: 212fc526-2a3a-4634-8ed9-1aef43e5a08f with Priority: HIGHEST for action port [ 668.243719] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 212fc526-2a3a-4634-8ed9-1aef43e5a08f with Priority: HIGHEST for action port [ 668.244081] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-212fc526-2a3a-4634-8ed9-1aef43e5a08f taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.244208] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-212fc526-2a3a-4634-8ed9-1aef43e5a08f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.244275] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-212fc526-2a3a-4634-8ed9-1aef43e5a08f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.244535] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-212fc526-2a3a-4634-8ed9-1aef43e5a08f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.244622] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('212fc526-2a3a-4634-8ed9-1aef43e5a08f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.252451] env[65471]: INFO networking_nsxv3.common.synchronization [None req-71e6d0ad-8394-4be8-9a18-30bd1acb8dce None None] Enqueued Resource ID: f4be25e7-93dd-4fd7-a7ad-2292635cbf9e with Priority: HIGHEST for action port [ 668.252944] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4be25e7-93dd-4fd7-a7ad-2292635cbf9e with Priority: HIGHEST for action port [ 668.253336] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-f4be25e7-93dd-4fd7-a7ad-2292635cbf9e taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.253446] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f4be25e7-93dd-4fd7-a7ad-2292635cbf9e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.253446] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f4be25e7-93dd-4fd7-a7ad-2292635cbf9e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.253693] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f4be25e7-93dd-4fd7-a7ad-2292635cbf9e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.253774] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4be25e7-93dd-4fd7-a7ad-2292635cbf9e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.719166] env[65471]: INFO networking_nsxv3.common.synchronization [req-55fe5d0a-1da4-4773-b826-eee0873ab0dd req-b068a1d1-ee12-4856-a875-f969a8c8adb5 service nova] Enqueued Resource ID: fc157df5-294c-4a29-82ae-e1ec842611f3 with Priority: HIGHEST for action security_group_rules [ 668.719484] env[65471]: INFO networking_nsxv3.common.synchronization [req-55fe5d0a-1da4-4773-b826-eee0873ab0dd req-b068a1d1-ee12-4856-a875-f969a8c8adb5 service nova] Enqueued Resource ID: fc157df5-294c-4a29-82ae-e1ec842611f3 with Priority: HIGHEST for action security_group_members [ 668.719484] env[65471]: INFO networking_nsxv3.common.synchronization [req-55fe5d0a-1da4-4773-b826-eee0873ab0dd req-b068a1d1-ee12-4856-a875-f969a8c8adb5 service nova] Enqueued Resource ID: c2da4160-0320-4461-8854-f5dd78c63a26 with Priority: HIGHEST for action port [ 668.721847] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc157df5-294c-4a29-82ae-e1ec842611f3 with Priority: HIGHEST for action security_group_rules [ 668.721847] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc157df5-294c-4a29-82ae-e1ec842611f3 with Priority: HIGHEST for action security_group_members [ 668.721847] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2da4160-0320-4461-8854-f5dd78c63a26 with Priority: HIGHEST for action port [ 668.721847] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fc157df5-294c-4a29-82ae-e1ec842611f3 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.721847] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fc157df5-294c-4a29-82ae-e1ec842611f3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.721847] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fc157df5-294c-4a29-82ae-e1ec842611f3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.721847] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fc157df5-294c-4a29-82ae-e1ec842611f3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.722270] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fc157df5-294c-4a29-82ae-e1ec842611f3',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.724121] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc157df5-294c-4a29-82ae-e1ec842611f3 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.724300] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc157df5-294c-4a29-82ae-e1ec842611f3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.724474] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc157df5-294c-4a29-82ae-e1ec842611f3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.725641] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc157df5-294c-4a29-82ae-e1ec842611f3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.725641] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.725641] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.725641] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.725641] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.725641] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.727112] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc157df5-294c-4a29-82ae-e1ec842611f3',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.728430] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2da4160-0320-4461-8854-f5dd78c63a26 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.728430] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2da4160-0320-4461-8854-f5dd78c63a26" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.728430] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2da4160-0320-4461-8854-f5dd78c63a26" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.728430] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2da4160-0320-4461-8854-f5dd78c63a26" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.728430] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2da4160-0320-4461-8854-f5dd78c63a26',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.750533] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 212fc526-2a3a-4634-8ed9-1aef43e5a08f [ 668.750533] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.750533] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.750533] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.750533] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.750533] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.750533] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:212fc526-2a3a-4634-8ed9-1aef43e5a08f already deleted. [ 668.750533] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-212fc526-2a3a-4634-8ed9-1aef43e5a08f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.757495] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f4be25e7-93dd-4fd7-a7ad-2292635cbf9e [ 668.757495] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.757495] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.757495] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.757495] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.757495] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.757495] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f4be25e7-93dd-4fd7-a7ad-2292635cbf9e already deleted. [ 668.757495] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f4be25e7-93dd-4fd7-a7ad-2292635cbf9e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.165844] env[65471]: INFO networking_nsxv3.common.synchronization [req-b5053011-444b-4a10-833f-344faefe1bfe req-cc3c1e38-48a8-4edf-9f12-69a21a1c1b9c tempest-ServerActionsTestOtherB-402089456 tempest-ServerActionsTestOtherB-402089456-project-member] Enqueued Resource ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 with Priority: HIGHEST for action security_group_members [ 669.165844] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 with Priority: HIGHEST for action security_group_members [ 669.167505] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-b71ce0e0-83fe-4f36-8617-e29f83b0be32 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.167505] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.167505] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.167505] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.167505] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.167505] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.167505] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.167505] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.167505] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.167505] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b71ce0e0-83fe-4f36-8617-e29f83b0be32',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.224252] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc157df5-294c-4a29-82ae-e1ec842611f3 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.224427] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc157df5-294c-4a29-82ae-e1ec842611f3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.227824] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fc157df5-294c-4a29-82ae-e1ec842611f3',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.229402] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c2da4160-0320-4461-8854-f5dd78c63a26 with status ACTIVE [ 669.229673] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.229836] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.229918] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.230201] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.230345] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.230520] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.230659] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.230728] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.230922] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.231023] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.231268] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.231399] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.231481] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.231664] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.231765] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.231873] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c2da4160-0320-4461-8854-f5dd78c63a26 is going to be updated. [ 669.261218] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.261387] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.261431] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.261624] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.261761] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.261927] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2da4160-0320-4461-8854-f5dd78c63a26" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.639128] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock network-852 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.639128] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "network-852" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.639128] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "network-852" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.639128] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "network-852" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.639128] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.640277] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.640848] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.640848] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.641000] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.642882] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 669.642882] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 669.642882] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 669.642882] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 669.642882] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 669.643288] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 669.643288] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 669.663902] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 669.663902] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 669.663902] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 669.664053] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "network-852" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.664672] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock port-546412cb-5a8f-4d4e-ab83-9921e12db3e1 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.664787] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "port-546412cb-5a8f-4d4e-ab83-9921e12db3e1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.664892] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "port-546412cb-5a8f-4d4e-ab83-9921e12db3e1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.667034] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "port-546412cb-5a8f-4d4e-ab83-9921e12db3e1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.667034] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('546412cb-5a8f-4d4e-ab83-9921e12db3e1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.670953] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.671113] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.671183] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.671389] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.671480] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.671708] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.671784] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.671819] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.671997] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.672087] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.672175] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 already deleted. [ 669.672254] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.731905] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fc157df5-294c-4a29-82ae-e1ec842611f3',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.175024] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.175024] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.175024] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.175024] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.175024] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.175024] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Segment Port 546412cb-5a8f-4d4e-ab83-9921e12db3e1 not found, creating... [ 670.175024] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.175024] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.175024] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.175024] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.175024] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.175580] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.175580] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.175580] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.175580] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.175580] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.175580] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Resource: SegmentPort with ID: 546412cb-5a8f-4d4e-ab83-9921e12db3e1 is going to be created. [ 670.209773] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.209773] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.209773] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.209773] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.209773] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.209773] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "port-546412cb-5a8f-4d4e-ab83-9921e12db3e1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.234963] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.235851] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.236104] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.236421] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.236628] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.236906] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc157df5-294c-4a29-82ae-e1ec842611f3 is going to be created. [ 670.271060] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.271060] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.271060] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.271060] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.271060] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.281417] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc157df5-294c-4a29-82ae-e1ec842611f3 in Status: UNINITIALIZED for 2s [ 670.774414] env[65471]: INFO networking_nsxv3.common.synchronization [None req-b4d3cf0a-41cd-4aae-b771-655fbc15025c None None] Enqueued Resource ID: 30bbb8c6-4d6f-4ce1-a622-fab9f5745eb4 with Priority: HIGHEST for action port [ 670.774982] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30bbb8c6-4d6f-4ce1-a622-fab9f5745eb4 with Priority: HIGHEST for action port [ 670.775683] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-30bbb8c6-4d6f-4ce1-a622-fab9f5745eb4 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.775683] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-30bbb8c6-4d6f-4ce1-a622-fab9f5745eb4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.775683] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-30bbb8c6-4d6f-4ce1-a622-fab9f5745eb4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.776481] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-30bbb8c6-4d6f-4ce1-a622-fab9f5745eb4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.776481] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30bbb8c6-4d6f-4ce1-a622-fab9f5745eb4',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.977157] env[65471]: INFO networking_nsxv3.common.synchronization [req-b5053011-444b-4a10-833f-344faefe1bfe req-14f7c87e-a442-43ef-b546-c2a8cd2705b8 service nova] Enqueued Resource ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 with Priority: HIGHEST for action security_group_rules [ 670.977157] env[65471]: INFO networking_nsxv3.common.synchronization [req-b5053011-444b-4a10-833f-344faefe1bfe req-14f7c87e-a442-43ef-b546-c2a8cd2705b8 service nova] Enqueued Resource ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 with Priority: HIGHEST for action security_group_members [ 670.977277] env[65471]: INFO networking_nsxv3.common.synchronization [req-b5053011-444b-4a10-833f-344faefe1bfe req-14f7c87e-a442-43ef-b546-c2a8cd2705b8 service nova] Enqueued Resource ID: 546412cb-5a8f-4d4e-ab83-9921e12db3e1 with Priority: HIGHEST for action port [ 670.977975] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 with Priority: HIGHEST for action security_group_rules [ 670.978291] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 with Priority: HIGHEST for action security_group_members [ 670.978291] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 546412cb-5a8f-4d4e-ab83-9921e12db3e1 with Priority: HIGHEST for action port [ 670.978786] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b71ce0e0-83fe-4f36-8617-e29f83b0be32 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.978786] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.979098] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.979301] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.979301] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b71ce0e0-83fe-4f36-8617-e29f83b0be32',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.980707] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-b71ce0e0-83fe-4f36-8617-e29f83b0be32 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.980910] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.981097] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.981210] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.982806] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.982806] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.982806] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.982806] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.982806] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.982806] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b71ce0e0-83fe-4f36-8617-e29f83b0be32',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.983505] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-546412cb-5a8f-4d4e-ab83-9921e12db3e1 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.983505] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-546412cb-5a8f-4d4e-ab83-9921e12db3e1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.983505] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-546412cb-5a8f-4d4e-ab83-9921e12db3e1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.983729] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-546412cb-5a8f-4d4e-ab83-9921e12db3e1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.983815] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('546412cb-5a8f-4d4e-ab83-9921e12db3e1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.277981] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 30bbb8c6-4d6f-4ce1-a622-fab9f5745eb4 [ 671.278989] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.279534] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.279927] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.280393] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.280672] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.281342] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:30bbb8c6-4d6f-4ce1-a622-fab9f5745eb4 already deleted. [ 671.281609] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-30bbb8c6-4d6f-4ce1-a622-fab9f5745eb4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.485781] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-b71ce0e0-83fe-4f36-8617-e29f83b0be32 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.485781] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.485980] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b71ce0e0-83fe-4f36-8617-e29f83b0be32',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.486932] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 546412cb-5a8f-4d4e-ab83-9921e12db3e1 with status ACTIVE [ 671.487314] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.487314] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.487314] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.487503] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.487665] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.489941] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.489941] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.489941] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.489941] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.489941] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.489941] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.489941] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.489941] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.489941] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.489941] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.489941] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 546412cb-5a8f-4d4e-ab83-9921e12db3e1 is going to be updated. [ 671.511592] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.511937] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.512035] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.512252] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.512402] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.512574] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-546412cb-5a8f-4d4e-ab83-9921e12db3e1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.538136] env[65471]: INFO networking_nsxv3.common.synchronization [req-69feed80-67ed-4fa0-9d66-54eac971774d req-44720130-b4ef-4b68-b757-f9c55a1ff036 tempest-ServersAdminNegativeTestJSON-7494399 tempest-ServersAdminNegativeTestJSON-7494399-project-member] Enqueued Resource ID: 14a38584-d8ef-4361-b344-b91e376144fa with Priority: HIGHEST for action security_group_members [ 671.538577] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14a38584-d8ef-4361-b344-b91e376144fa with Priority: HIGHEST for action security_group_members [ 671.538910] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-14a38584-d8ef-4361-b344-b91e376144fa taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.539095] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14a38584-d8ef-4361-b344-b91e376144fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.539196] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14a38584-d8ef-4361-b344-b91e376144fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.539434] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14a38584-d8ef-4361-b344-b91e376144fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.539655] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.539801] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.539892] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.540105] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.540233] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.540356] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14a38584-d8ef-4361-b344-b91e376144fa',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.869696] env[65471]: INFO networking_nsxv3.common.synchronization [None req-30e1035c-8e5b-42c2-b096-3251a3e9cc3b tempest-ServersTestManualDisk-1928283683 tempest-ServersTestManualDisk-1928283683-project-member] Enqueued Resource ID: cd8e3453-8620-4f9d-b764-155e97a20205 with Priority: HIGHEST for action security_group_rules [ 671.871044] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd8e3453-8620-4f9d-b764-155e97a20205 with Priority: HIGHEST for action security_group_rules [ 671.871543] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd8e3453-8620-4f9d-b764-155e97a20205 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.871774] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd8e3453-8620-4f9d-b764-155e97a20205" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.871924] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd8e3453-8620-4f9d-b764-155e97a20205" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.872319] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd8e3453-8620-4f9d-b764-155e97a20205" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.872485] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd8e3453-8620-4f9d-b764-155e97a20205',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.992487] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b71ce0e0-83fe-4f36-8617-e29f83b0be32',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.042805] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('14a38584-d8ef-4361-b344-b91e376144fa',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.280901] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock network-647 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.280901] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "network-647" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.280901] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "network-647" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.280901] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "network-647" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.280901] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.280901] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.280901] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.280901] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.281518] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.281841] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 672.282104] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 672.282460] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 672.282678] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 672.282880] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 672.285021] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 672.285021] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 672.298022] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc157df5-294c-4a29-82ae-e1ec842611f3 in Status: SUCCESS [ 672.298022] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc157df5-294c-4a29-82ae-e1ec842611f3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.298022] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc157df5-294c-4a29-82ae-e1ec842611f3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.298022] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc157df5-294c-4a29-82ae-e1ec842611f3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.298022] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.298022] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.298022] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.298022] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.298022] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.298022] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc157df5-294c-4a29-82ae-e1ec842611f3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.298022] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fc157df5-294c-4a29-82ae-e1ec842611f3',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.311099] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 672.311099] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 672.311099] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 672.311099] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "network-647" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.311099] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock port-a5fd5688-c281-4a21-9fd4-eaa1158efe34 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.311772] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "port-a5fd5688-c281-4a21-9fd4-eaa1158efe34" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.312143] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "port-a5fd5688-c281-4a21-9fd4-eaa1158efe34" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.312595] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "port-a5fd5688-c281-4a21-9fd4-eaa1158efe34" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.313969] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5fd5688-c281-4a21-9fd4-eaa1158efe34',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.397769] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.398124] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.398124] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.398270] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.398360] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.398452] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd8e3453-8620-4f9d-b764-155e97a20205 already deleted. [ 672.398536] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd8e3453-8620-4f9d-b764-155e97a20205" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.489424] env[65471]: INFO networking_nsxv3.common.synchronization [None req-2c8b678b-65d8-406c-960e-e320b0a604c7 None None] Enqueued Resource ID: 4b1e441a-8bb0-4552-a69a-fe06bacfdd7a with Priority: HIGHEST for action port [ 672.489424] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b1e441a-8bb0-4552-a69a-fe06bacfdd7a with Priority: HIGHEST for action port [ 672.491122] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-4b1e441a-8bb0-4552-a69a-fe06bacfdd7a taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.491122] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4b1e441a-8bb0-4552-a69a-fe06bacfdd7a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.491122] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4b1e441a-8bb0-4552-a69a-fe06bacfdd7a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.491122] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4b1e441a-8bb0-4552-a69a-fe06bacfdd7a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.491122] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b1e441a-8bb0-4552-a69a-fe06bacfdd7a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.495481] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.495600] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.495692] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.495854] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.495973] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.496053] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 is going to be created. [ 672.522965] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.523165] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.523210] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.523412] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.523544] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.535044] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 in Status: UNINITIALIZED for 2s [ 672.546260] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('14a38584-d8ef-4361-b344-b91e376144fa',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.800395] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc157df5-294c-4a29-82ae-e1ec842611f3 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.800783] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc157df5-294c-4a29-82ae-e1ec842611f3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.800783] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc157df5-294c-4a29-82ae-e1ec842611f3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.801056] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc157df5-294c-4a29-82ae-e1ec842611f3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.801056] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.801169] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.801213] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.801354] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.801472] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.801522] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc157df5-294c-4a29-82ae-e1ec842611f3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.801664] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc157df5-294c-4a29-82ae-e1ec842611f3 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.801739] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc157df5-294c-4a29-82ae-e1ec842611f3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.801802] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc157df5-294c-4a29-82ae-e1ec842611f3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.801940] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc157df5-294c-4a29-82ae-e1ec842611f3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.802091] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.802181] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.802231] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.802364] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.802431] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.802522] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc157df5-294c-4a29-82ae-e1ec842611f3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.802625] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fc157df5-294c-4a29-82ae-e1ec842611f3',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.815741] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.819018] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.819018] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.819018] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.819018] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.819018] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Segment Port a5fd5688-c281-4a21-9fd4-eaa1158efe34 not found, creating... [ 672.819018] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.819018] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.819018] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.819018] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.819018] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.819438] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.819438] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.819438] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.819438] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.819438] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.819438] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Resource: SegmentPort with ID: a5fd5688-c281-4a21-9fd4-eaa1158efe34 is going to be created. [ 672.844383] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.844383] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.844383] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.844383] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.844383] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.844383] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "port-a5fd5688-c281-4a21-9fd4-eaa1158efe34" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.972160] env[65471]: INFO networking_nsxv3.common.synchronization [None req-3b4258e7-c98f-44ac-babb-2c7d5c41bfd1 tempest-ServersTestManualDisk-1928283683 tempest-ServersTestManualDisk-1928283683-project-member] Enqueued Resource ID: cd8e3453-8620-4f9d-b764-155e97a20205 with Priority: HIGHEST for action security_group_rules [ 672.972766] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd8e3453-8620-4f9d-b764-155e97a20205 with Priority: HIGHEST for action security_group_rules [ 672.973096] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd8e3453-8620-4f9d-b764-155e97a20205 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.973258] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd8e3453-8620-4f9d-b764-155e97a20205" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.973329] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd8e3453-8620-4f9d-b764-155e97a20205" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.973587] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd8e3453-8620-4f9d-b764-155e97a20205" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.973694] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd8e3453-8620-4f9d-b764-155e97a20205',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.996543] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4b1e441a-8bb0-4552-a69a-fe06bacfdd7a [ 672.996543] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.996543] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.996543] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.996543] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.996543] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.996543] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4b1e441a-8bb0-4552-a69a-fe06bacfdd7a already deleted. [ 672.996543] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4b1e441a-8bb0-4552-a69a-fe06bacfdd7a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.050415] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.050415] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.050415] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.050415] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.050415] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.050415] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14a38584-d8ef-4361-b344-b91e376144fa is going to be updated. [ 673.083995] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.083995] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.083995] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.084255] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.084298] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.098373] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14a38584-d8ef-4361-b344-b91e376144fa in Status: IN_PROGRESS for 2s [ 673.306461] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fc157df5-294c-4a29-82ae-e1ec842611f3: rpc.has_security_group_logging(os_id): False [ 673.328963] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.329248] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.329248] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.329421] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.330077] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.330077] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.330077] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.330077] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.330077] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.330499] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.330499] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.330499] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.330499] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.330674] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.330674] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.330940] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.332251] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.332251] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.332251] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.332251] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.332251] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fc157df5-294c-4a29-82ae-e1ec842611f3 is going to be created. [ 673.412051] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.412051] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.412051] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.412051] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.412051] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.437931] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc157df5-294c-4a29-82ae-e1ec842611f3 in Status: IN_PROGRESS for 2s [ 673.508534] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.508726] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.508726] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.509747] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.509747] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.509747] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd8e3453-8620-4f9d-b764-155e97a20205 already deleted. [ 673.509747] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd8e3453-8620-4f9d-b764-155e97a20205" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.597139] env[65471]: INFO networking_nsxv3.common.synchronization [req-69feed80-67ed-4fa0-9d66-54eac971774d req-d6d99dec-0f27-4752-a26f-31d9571e6c53 service nova] Enqueued Resource ID: 14a38584-d8ef-4361-b344-b91e376144fa with Priority: HIGHEST for action security_group_rules [ 673.597322] env[65471]: INFO networking_nsxv3.common.synchronization [req-69feed80-67ed-4fa0-9d66-54eac971774d req-d6d99dec-0f27-4752-a26f-31d9571e6c53 service nova] Enqueued Resource ID: 14a38584-d8ef-4361-b344-b91e376144fa with Priority: HIGHEST for action security_group_members [ 673.597454] env[65471]: INFO networking_nsxv3.common.synchronization [req-69feed80-67ed-4fa0-9d66-54eac971774d req-d6d99dec-0f27-4752-a26f-31d9571e6c53 service nova] Enqueued Resource ID: a5fd5688-c281-4a21-9fd4-eaa1158efe34 with Priority: HIGHEST for action port [ 673.598335] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14a38584-d8ef-4361-b344-b91e376144fa with Priority: HIGHEST for action security_group_rules [ 673.598794] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14a38584-d8ef-4361-b344-b91e376144fa with Priority: HIGHEST for action security_group_members [ 673.599836] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5fd5688-c281-4a21-9fd4-eaa1158efe34 with Priority: HIGHEST for action port [ 673.600190] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14a38584-d8ef-4361-b344-b91e376144fa taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.600324] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14a38584-d8ef-4361-b344-b91e376144fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.600396] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14a38584-d8ef-4361-b344-b91e376144fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.600629] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14a38584-d8ef-4361-b344-b91e376144fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.600715] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14a38584-d8ef-4361-b344-b91e376144fa',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.601589] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-14a38584-d8ef-4361-b344-b91e376144fa taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.601677] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14a38584-d8ef-4361-b344-b91e376144fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.601907] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-a5fd5688-c281-4a21-9fd4-eaa1158efe34 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.605053] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a5fd5688-c281-4a21-9fd4-eaa1158efe34" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.605053] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a5fd5688-c281-4a21-9fd4-eaa1158efe34" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.605347] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a5fd5688-c281-4a21-9fd4-eaa1158efe34" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.605347] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5fd5688-c281-4a21-9fd4-eaa1158efe34',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.107456] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-14a38584-d8ef-4361-b344-b91e376144fa taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.107940] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14a38584-d8ef-4361-b344-b91e376144fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.107940] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a5fd5688-c281-4a21-9fd4-eaa1158efe34 with status ACTIVE [ 674.108069] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.108128] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.108192] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.108412] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.108660] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.108741] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.108840] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.108887] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.109030] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.109103] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.109286] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.109379] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.109439] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.109685] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.109685] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.109831] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a5fd5688-c281-4a21-9fd4-eaa1158efe34 is going to be updated. [ 674.131492] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.131767] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.131767] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.132058] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.132236] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.132418] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a5fd5688-c281-4a21-9fd4-eaa1158efe34" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.162306] env[65471]: INFO networking_nsxv3.common.synchronization [req-63e35257-da33-4dcb-ae02-ab18bacf7ab6 req-def2d936-ffea-4ede-b6a1-129dda9879f6 tempest-DeleteServersAdminTestJSON-1981732508 tempest-DeleteServersAdminTestJSON-1981732508-project-member] Enqueued Resource ID: 49f0917b-c43e-421e-9ccf-fe8487bf2b37 with Priority: HIGHEST for action security_group_members [ 674.162881] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49f0917b-c43e-421e-9ccf-fe8487bf2b37 with Priority: HIGHEST for action security_group_members [ 674.163818] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-49f0917b-c43e-421e-9ccf-fe8487bf2b37 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.163818] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49f0917b-c43e-421e-9ccf-fe8487bf2b37" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.163818] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49f0917b-c43e-421e-9ccf-fe8487bf2b37" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.163818] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49f0917b-c43e-421e-9ccf-fe8487bf2b37" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.164106] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.164106] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.164106] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.164314] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.164360] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.164613] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49f0917b-c43e-421e-9ccf-fe8487bf2b37',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.194700] env[65471]: INFO networking_nsxv3.common.synchronization [req-09b2bc56-f042-4b65-a1d7-6167bad42fb2 req-38df7fde-3261-4773-a80a-33865703cc60 tempest-ServerMetadataTestJSON-51384864 tempest-ServerMetadataTestJSON-51384864-project-member] Enqueued Resource ID: 2a9f3871-1bad-4130-b669-97b85ced692d with Priority: HIGHEST for action security_group_members [ 674.195063] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a9f3871-1bad-4130-b669-97b85ced692d with Priority: HIGHEST for action security_group_members [ 674.195432] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a9f3871-1bad-4130-b669-97b85ced692d taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.195533] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a9f3871-1bad-4130-b669-97b85ced692d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.195575] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a9f3871-1bad-4130-b669-97b85ced692d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.195808] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a9f3871-1bad-4130-b669-97b85ced692d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.196282] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.196408] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.196474] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.196636] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.196720] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.196867] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a9f3871-1bad-4130-b669-97b85ced692d',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.401485] env[65471]: INFO networking_nsxv3.common.synchronization [None req-94196dee-1e1d-4871-84a6-cbf752171a13 None None] Enqueued Resource ID: 9becc4ba-a355-4b16-b04c-ff69bd8d7035 with Priority: HIGHEST for action port [ 674.403098] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9becc4ba-a355-4b16-b04c-ff69bd8d7035 with Priority: HIGHEST for action port [ 674.404149] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-9becc4ba-a355-4b16-b04c-ff69bd8d7035 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.405245] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9becc4ba-a355-4b16-b04c-ff69bd8d7035" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.405461] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9becc4ba-a355-4b16-b04c-ff69bd8d7035" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.406196] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9becc4ba-a355-4b16-b04c-ff69bd8d7035" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.406426] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9becc4ba-a355-4b16-b04c-ff69bd8d7035',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.549039] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 in Status: SUCCESS [ 674.549248] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.549452] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.550037] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.550191] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.550421] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.550421] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.550847] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.550847] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.550997] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.556276] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b71ce0e0-83fe-4f36-8617-e29f83b0be32',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.641436] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock network-300 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.641687] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "network-300" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.641791] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "network-300" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.643233] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "network-300" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.643233] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.643233] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.643233] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.643233] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.643233] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.643233] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 674.643766] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 674.643766] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 674.643766] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 674.643766] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 674.643766] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 674.643923] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 674.662581] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 674.662702] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 674.663397] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 674.663397] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "network-300" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.663478] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock port-61f6a9d5-5b47-4800-8a44-4e7eca681780 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.663651] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "port-61f6a9d5-5b47-4800-8a44-4e7eca681780" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.663837] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "port-61f6a9d5-5b47-4800-8a44-4e7eca681780" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.664187] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "port-61f6a9d5-5b47-4800-8a44-4e7eca681780" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.664316] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61f6a9d5-5b47-4800-8a44-4e7eca681780',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.666546] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.666777] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.666910] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.667153] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.667246] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.667441] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.667573] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.667636] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.667779] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.667858] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.667942] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49f0917b-c43e-421e-9ccf-fe8487bf2b37 is going to be updated. [ 674.700150] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.700475] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.700543] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.701639] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.701771] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.702130] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.702283] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.702351] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.702560] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.702645] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.702735] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a9f3871-1bad-4130-b669-97b85ced692d already deleted. [ 674.702838] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a9f3871-1bad-4130-b669-97b85ced692d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.714382] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.714382] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.714382] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.714382] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.714843] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.726334] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49f0917b-c43e-421e-9ccf-fe8487bf2b37 in Status: IN_PROGRESS for 2s [ 674.910428] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9becc4ba-a355-4b16-b04c-ff69bd8d7035 [ 674.911077] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.911899] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.912175] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.912535] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.913544] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.913544] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9becc4ba-a355-4b16-b04c-ff69bd8d7035 already deleted. [ 674.913544] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9becc4ba-a355-4b16-b04c-ff69bd8d7035" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.060316] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b71ce0e0-83fe-4f36-8617-e29f83b0be32',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.112579] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14a38584-d8ef-4361-b344-b91e376144fa in Status: SUCCESS [ 675.113482] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14a38584-d8ef-4361-b344-b91e376144fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.113482] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14a38584-d8ef-4361-b344-b91e376144fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.113482] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14a38584-d8ef-4361-b344-b91e376144fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.113667] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.113820] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.113921] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.114131] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.114286] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.114344] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14a38584-d8ef-4361-b344-b91e376144fa',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.136101] env[65471]: INFO networking_nsxv3.common.synchronization [None req-f817d365-be76-4ff5-915b-4dfc9c51a89a tempest-ServerActionsTestOtherA-1623203122 tempest-ServerActionsTestOtherA-1623203122-project-member] Enqueued Resource ID: f7dafcbc-15be-4704-ad92-28657ead70aa with Priority: HIGHEST for action security_group_rules [ 675.136101] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7dafcbc-15be-4704-ad92-28657ead70aa with Priority: HIGHEST for action security_group_rules [ 675.140576] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7dafcbc-15be-4704-ad92-28657ead70aa taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.140877] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.140877] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.141345] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.141345] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7dafcbc-15be-4704-ad92-28657ead70aa',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.167142] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.167385] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.167694] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.172064] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.172064] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.172064] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Segment Port 61f6a9d5-5b47-4800-8a44-4e7eca681780 not found, creating... [ 675.172064] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.172064] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.172064] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.172064] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.172064] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.172064] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.172064] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.172626] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.172626] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.172626] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.172626] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Resource: SegmentPort with ID: 61f6a9d5-5b47-4800-8a44-4e7eca681780 is going to be created. [ 675.210592] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.210592] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.210592] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.211153] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.211153] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.211298] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "port-61f6a9d5-5b47-4800-8a44-4e7eca681780" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.452459] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc157df5-294c-4a29-82ae-e1ec842611f3 in Status: SUCCESS [ 675.452459] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fc157df5-294c-4a29-82ae-e1ec842611f3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.563093] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b71ce0e0-83fe-4f36-8617-e29f83b0be32: rpc.has_security_group_logging(os_id): False [ 675.582907] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.582907] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.582907] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.582907] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.582907] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.583283] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.583433] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.583433] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.587119] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.587119] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.587119] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 is going to be created. [ 675.616904] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('14a38584-d8ef-4361-b344-b91e376144fa',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.656048] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.656048] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.656048] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.656380] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.656618] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.666659] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.666659] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.666659] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.667215] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.667215] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.667215] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7dafcbc-15be-4704-ad92-28657ead70aa already deleted. [ 675.667215] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.668239] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 in Status: IN_PROGRESS for 2s [ 675.702200] env[65471]: INFO networking_nsxv3.common.synchronization [None req-8fac259a-a9ae-44d1-803d-3e6575917ff4 None None] Enqueued Resource ID: 1fec97d3-4cfc-4b43-bd1d-6583840363d4 with Priority: HIGHEST for action port [ 675.702857] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fec97d3-4cfc-4b43-bd1d-6583840363d4 with Priority: HIGHEST for action port [ 675.703729] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-1fec97d3-4cfc-4b43-bd1d-6583840363d4 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.704037] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1fec97d3-4cfc-4b43-bd1d-6583840363d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.704227] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1fec97d3-4cfc-4b43-bd1d-6583840363d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.704709] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1fec97d3-4cfc-4b43-bd1d-6583840363d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.704933] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1fec97d3-4cfc-4b43-bd1d-6583840363d4',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.920450] env[65471]: INFO networking_nsxv3.common.synchronization [req-09b2bc56-f042-4b65-a1d7-6167bad42fb2 req-b3c69134-967a-4eee-b37a-71630914b350 service nova] Enqueued Resource ID: 2a9f3871-1bad-4130-b669-97b85ced692d with Priority: HIGHEST for action security_group_rules [ 675.920450] env[65471]: INFO networking_nsxv3.common.synchronization [req-09b2bc56-f042-4b65-a1d7-6167bad42fb2 req-b3c69134-967a-4eee-b37a-71630914b350 service nova] Enqueued Resource ID: 2a9f3871-1bad-4130-b669-97b85ced692d with Priority: HIGHEST for action security_group_members [ 675.920542] env[65471]: INFO networking_nsxv3.common.synchronization [req-09b2bc56-f042-4b65-a1d7-6167bad42fb2 req-b3c69134-967a-4eee-b37a-71630914b350 service nova] Enqueued Resource ID: 61f6a9d5-5b47-4800-8a44-4e7eca681780 with Priority: HIGHEST for action port [ 675.921099] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a9f3871-1bad-4130-b669-97b85ced692d with Priority: HIGHEST for action security_group_rules [ 675.921239] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a9f3871-1bad-4130-b669-97b85ced692d with Priority: HIGHEST for action security_group_members [ 675.921333] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61f6a9d5-5b47-4800-8a44-4e7eca681780 with Priority: HIGHEST for action port [ 675.921607] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2a9f3871-1bad-4130-b669-97b85ced692d taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.921730] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2a9f3871-1bad-4130-b669-97b85ced692d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.921819] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2a9f3871-1bad-4130-b669-97b85ced692d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.922075] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2a9f3871-1bad-4130-b669-97b85ced692d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.922190] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2a9f3871-1bad-4130-b669-97b85ced692d',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.924670] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a9f3871-1bad-4130-b669-97b85ced692d taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.924787] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a9f3871-1bad-4130-b669-97b85ced692d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.924893] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a9f3871-1bad-4130-b669-97b85ced692d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.925103] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a9f3871-1bad-4130-b669-97b85ced692d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.925175] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.925269] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.926039] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.926039] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.926039] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.926039] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a9f3871-1bad-4130-b669-97b85ced692d',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.926371] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-61f6a9d5-5b47-4800-8a44-4e7eca681780 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.926475] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-61f6a9d5-5b47-4800-8a44-4e7eca681780" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.926554] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-61f6a9d5-5b47-4800-8a44-4e7eca681780" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.926746] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-61f6a9d5-5b47-4800-8a44-4e7eca681780" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.926746] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61f6a9d5-5b47-4800-8a44-4e7eca681780',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.020306] env[65471]: INFO networking_nsxv3.common.synchronization [None req-7a4e6d05-553c-4308-9962-60ea19bd4646 tempest-ServerActionsTestOtherA-1623203122 tempest-ServerActionsTestOtherA-1623203122-project-member] Enqueued Resource ID: f7dafcbc-15be-4704-ad92-28657ead70aa with Priority: HIGHEST for action security_group_rules [ 676.020739] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7dafcbc-15be-4704-ad92-28657ead70aa with Priority: HIGHEST for action security_group_rules [ 676.021051] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7dafcbc-15be-4704-ad92-28657ead70aa taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.021173] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.021240] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.021437] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.021519] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7dafcbc-15be-4704-ad92-28657ead70aa',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.119635] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('14a38584-d8ef-4361-b344-b91e376144fa',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.207436] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1fec97d3-4cfc-4b43-bd1d-6583840363d4 [ 676.207732] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.207904] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.208029] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.208270] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.208390] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.208514] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1fec97d3-4cfc-4b43-bd1d-6583840363d4 already deleted. [ 676.208621] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1fec97d3-4cfc-4b43-bd1d-6583840363d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.428464] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a9f3871-1bad-4130-b669-97b85ced692d taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.428681] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a9f3871-1bad-4130-b669-97b85ced692d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.428795] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2a9f3871-1bad-4130-b669-97b85ced692d',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.432030] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 61f6a9d5-5b47-4800-8a44-4e7eca681780 with status ACTIVE [ 676.432874] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.433269] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.433362] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.433963] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.434192] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.434466] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.435282] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.435282] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.435907] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.436731] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.436971] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.437096] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.437183] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.437354] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.437440] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.437537] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 61f6a9d5-5b47-4800-8a44-4e7eca681780 is going to be updated. [ 676.463063] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.463408] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.463487] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.463818] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.463972] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.464167] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-61f6a9d5-5b47-4800-8a44-4e7eca681780" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.555364] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.555364] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.555364] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.555364] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.555364] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.555364] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7dafcbc-15be-4704-ad92-28657ead70aa already deleted. [ 676.555364] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.621715] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.621914] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.621995] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.622333] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.622393] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.622498] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14a38584-d8ef-4361-b344-b91e376144fa is going to be updated. [ 676.667531] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.667531] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.667531] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.667531] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.667531] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.679084] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14a38584-d8ef-4361-b344-b91e376144fa in Status: IN_PROGRESS for 2s [ 676.739497] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49f0917b-c43e-421e-9ccf-fe8487bf2b37 in Status: SUCCESS [ 676.739497] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49f0917b-c43e-421e-9ccf-fe8487bf2b37 deletion is rescheduled due to dependency. [ 676.739497] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49f0917b-c43e-421e-9ccf-fe8487bf2b37" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.932484] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2a9f3871-1bad-4130-b669-97b85ced692d',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.105940] env[65471]: INFO networking_nsxv3.common.synchronization [req-20e74c27-9cbe-439d-a273-fdff941ce5fc req-01ce4543-ebb1-4e36-a6da-6f21db8e53b6 tempest-MigrationsAdminTest-433965692 tempest-MigrationsAdminTest-433965692-project-member] Enqueued Resource ID: 2ecf6012-bc6c-4512-8d9d-962c10f0cad9 with Priority: HIGHEST for action security_group_members [ 677.106624] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ecf6012-bc6c-4512-8d9d-962c10f0cad9 with Priority: HIGHEST for action security_group_members [ 677.106930] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.107079] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.107148] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.107405] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.107779] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.108108] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.108108] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.108210] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.108246] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.108324] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ecf6012-bc6c-4512-8d9d-962c10f0cad9',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.435646] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.435930] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.435930] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.436349] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.436392] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.436490] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a9f3871-1bad-4130-b669-97b85ced692d is going to be created. [ 677.482723] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.482921] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.482921] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.483300] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.483300] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.493481] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a9f3871-1bad-4130-b669-97b85ced692d in Status: UNINITIALIZED for 2s [ 677.570581] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock network-647 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.571384] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "network-647" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.571384] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "network-647" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.571546] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "network-647" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.571907] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.572255] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.572430] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.572730] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.573115] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.573853] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 677.573853] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 677.573853] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 677.574032] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 677.574032] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 677.574336] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 677.574584] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 677.596537] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 677.596727] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 677.596920] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 677.597108] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "network-647" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.597427] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock port-18b1789f-fc32-4f56-a008-7057c5ad08a4 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.597605] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "port-18b1789f-fc32-4f56-a008-7057c5ad08a4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.597747] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "port-18b1789f-fc32-4f56-a008-7057c5ad08a4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.598086] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "port-18b1789f-fc32-4f56-a008-7057c5ad08a4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.598966] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18b1789f-fc32-4f56-a008-7057c5ad08a4',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.612948] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.612948] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.613132] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.613253] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.613576] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.613576] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.613691] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.613691] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.613828] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.613900] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.613997] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ecf6012-bc6c-4512-8d9d-962c10f0cad9 already deleted. [ 677.614072] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.681725] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 in Status: SUCCESS [ 677.682113] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.912563] env[65471]: INFO networking_nsxv3.common.synchronization [None req-a3a94c90-8ebc-4da1-b3c4-cb69de4326ab None None] Enqueued Resource ID: b8213ba5-11f1-48b0-b4e0-548d2d637395 with Priority: HIGHEST for action port [ 677.913129] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8213ba5-11f1-48b0-b4e0-548d2d637395 with Priority: HIGHEST for action port [ 677.913473] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-b8213ba5-11f1-48b0-b4e0-548d2d637395 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.913579] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b8213ba5-11f1-48b0-b4e0-548d2d637395" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.913681] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b8213ba5-11f1-48b0-b4e0-548d2d637395" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.913930] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b8213ba5-11f1-48b0-b4e0-548d2d637395" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.914152] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8213ba5-11f1-48b0-b4e0-548d2d637395',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.101223] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.101451] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.101577] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.102228] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.102228] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.102464] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Segment Port 18b1789f-fc32-4f56-a008-7057c5ad08a4 not found, creating... [ 678.102560] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.102710] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.102813] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.103046] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.103212] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.103502] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.103660] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.103754] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.103956] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.104165] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.104299] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Resource: SegmentPort with ID: 18b1789f-fc32-4f56-a008-7057c5ad08a4 is going to be created. [ 678.127114] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.127583] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.127583] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.129957] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.130266] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.130501] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "port-18b1789f-fc32-4f56-a008-7057c5ad08a4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.418852] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b8213ba5-11f1-48b0-b4e0-548d2d637395 [ 678.418852] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.418852] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.418852] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.419202] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.419239] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.419449] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b8213ba5-11f1-48b0-b4e0-548d2d637395 already deleted. [ 678.419449] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b8213ba5-11f1-48b0-b4e0-548d2d637395" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.689737] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14a38584-d8ef-4361-b344-b91e376144fa in Status: SUCCESS [ 678.690198] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14a38584-d8ef-4361-b344-b91e376144fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.690301] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14a38584-d8ef-4361-b344-b91e376144fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.690447] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14a38584-d8ef-4361-b344-b91e376144fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.690661] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.690802] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.690872] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.691056] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.691138] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.691221] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14a38584-d8ef-4361-b344-b91e376144fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.691317] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('14a38584-d8ef-4361-b344-b91e376144fa',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.866156] env[65471]: INFO networking_nsxv3.common.synchronization [req-20e74c27-9cbe-439d-a273-fdff941ce5fc req-2dff37e1-b4e7-425d-9fb1-a2aad7ce7b88 service nova] Enqueued Resource ID: 2ecf6012-bc6c-4512-8d9d-962c10f0cad9 with Priority: HIGHEST for action security_group_rules [ 678.866156] env[65471]: INFO networking_nsxv3.common.synchronization [req-20e74c27-9cbe-439d-a273-fdff941ce5fc req-2dff37e1-b4e7-425d-9fb1-a2aad7ce7b88 service nova] Enqueued Resource ID: 2ecf6012-bc6c-4512-8d9d-962c10f0cad9 with Priority: HIGHEST for action security_group_members [ 678.866156] env[65471]: INFO networking_nsxv3.common.synchronization [req-20e74c27-9cbe-439d-a273-fdff941ce5fc req-2dff37e1-b4e7-425d-9fb1-a2aad7ce7b88 service nova] Enqueued Resource ID: 18b1789f-fc32-4f56-a008-7057c5ad08a4 with Priority: HIGHEST for action port [ 678.868230] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ecf6012-bc6c-4512-8d9d-962c10f0cad9 with Priority: HIGHEST for action security_group_rules [ 678.868230] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ecf6012-bc6c-4512-8d9d-962c10f0cad9 with Priority: HIGHEST for action security_group_members [ 678.868230] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18b1789f-fc32-4f56-a008-7057c5ad08a4 with Priority: HIGHEST for action port [ 678.868230] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ecf6012-bc6c-4512-8d9d-962c10f0cad9 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.868230] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.868230] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.869216] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.869311] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ecf6012-bc6c-4512-8d9d-962c10f0cad9',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.870409] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.870513] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.870556] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.871551] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.871551] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.871551] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.871759] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.871759] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.871891] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.872124] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ecf6012-bc6c-4512-8d9d-962c10f0cad9',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.038620] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-18b1789f-fc32-4f56-a008-7057c5ad08a4 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.038884] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-18b1789f-fc32-4f56-a008-7057c5ad08a4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.039132] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-18b1789f-fc32-4f56-a008-7057c5ad08a4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.039427] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-18b1789f-fc32-4f56-a008-7057c5ad08a4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.039572] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18b1789f-fc32-4f56-a008-7057c5ad08a4',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.195816] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-14a38584-d8ef-4361-b344-b91e376144fa taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.196235] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14a38584-d8ef-4361-b344-b91e376144fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.196235] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14a38584-d8ef-4361-b344-b91e376144fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.196360] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14a38584-d8ef-4361-b344-b91e376144fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.196464] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.196569] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.196624] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.196775] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.196866] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.196936] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14a38584-d8ef-4361-b344-b91e376144fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.197100] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-14a38584-d8ef-4361-b344-b91e376144fa taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.197191] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14a38584-d8ef-4361-b344-b91e376144fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.197249] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14a38584-d8ef-4361-b344-b91e376144fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.197388] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14a38584-d8ef-4361-b344-b91e376144fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.197534] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.197694] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.197821] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.197893] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.197970] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.198058] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14a38584-d8ef-4361-b344-b91e376144fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.198147] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('14a38584-d8ef-4361-b344-b91e376144fa',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.511296] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a9f3871-1bad-4130-b669-97b85ced692d in Status: SUCCESS [ 679.512463] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a9f3871-1bad-4130-b669-97b85ced692d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.512463] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a9f3871-1bad-4130-b669-97b85ced692d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.512463] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a9f3871-1bad-4130-b669-97b85ced692d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.512463] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.512937] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.513049] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.513232] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.513318] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.513409] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a9f3871-1bad-4130-b669-97b85ced692d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.513506] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2a9f3871-1bad-4130-b669-97b85ced692d',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.539277] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2ecf6012-bc6c-4512-8d9d-962c10f0cad9',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.543857] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 18b1789f-fc32-4f56-a008-7057c5ad08a4 with status ACTIVE [ 679.544278] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.544278] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.544476] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.545058] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.545058] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.545058] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.545058] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.545322] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.545322] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.545411] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.545561] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.545664] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.545851] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.545896] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.545966] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.546067] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 18b1789f-fc32-4f56-a008-7057c5ad08a4 is going to be updated. [ 679.548302] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.548414] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.576504] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.576504] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.576504] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.576828] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.576828] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.577020] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-18b1789f-fc32-4f56-a008-7057c5ad08a4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.701864] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 14a38584-d8ef-4361-b344-b91e376144fa: rpc.has_security_group_logging(os_id): False [ 679.725441] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.725660] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.725786] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.726186] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.726325] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.726600] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.726743] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.726885] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.727202] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.727721] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.728653] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.728950] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.728950] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.729235] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.729396] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.729701] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.729867] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.729982] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.730237] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.734029] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.734029] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14a38584-d8ef-4361-b344-b91e376144fa is going to be updated. [ 679.800059] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.800284] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.800424] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.800757] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.800986] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.820120] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 14a38584-d8ef-4361-b344-b91e376144fa in Status: IN_PROGRESS for 2s [ 680.017555] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a9f3871-1bad-4130-b669-97b85ced692d taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.018628] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a9f3871-1bad-4130-b669-97b85ced692d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.018628] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a9f3871-1bad-4130-b669-97b85ced692d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.018628] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a9f3871-1bad-4130-b669-97b85ced692d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.018853] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.018980] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.019419] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.019602] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.019712] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.019803] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a9f3871-1bad-4130-b669-97b85ced692d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.019968] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a9f3871-1bad-4130-b669-97b85ced692d taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.020082] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a9f3871-1bad-4130-b669-97b85ced692d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.020143] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a9f3871-1bad-4130-b669-97b85ced692d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.020284] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a9f3871-1bad-4130-b669-97b85ced692d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.020425] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.020513] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.020572] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.020705] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.020792] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.020880] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a9f3871-1bad-4130-b669-97b85ced692d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.020969] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2a9f3871-1bad-4130-b669-97b85ced692d',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.049735] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2ecf6012-bc6c-4512-8d9d-962c10f0cad9',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.524081] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2a9f3871-1bad-4130-b669-97b85ced692d: rpc.has_security_group_logging(os_id): False [ 680.543488] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.543924] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.544173] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.544586] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.544839] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.545285] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.545559] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.545799] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.546167] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.546396] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.546770] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.547377] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.547377] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.547377] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.548079] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.548079] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.548318] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.548513] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.548816] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.549036] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.549255] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2a9f3871-1bad-4130-b669-97b85ced692d is going to be created. [ 680.551251] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.551516] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.551706] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.552027] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.552429] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.552429] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ecf6012-bc6c-4512-8d9d-962c10f0cad9 is going to be created. [ 680.584174] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.584404] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.584516] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.584845] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.585044] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.597402] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ecf6012-bc6c-4512-8d9d-962c10f0cad9 in Status: UNINITIALIZED for 2s [ 680.618862] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.619123] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.619173] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.620034] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.620034] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.634649] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a9f3871-1bad-4130-b669-97b85ced692d in Status: IN_PROGRESS for 2s [ 681.030173] env[65471]: INFO networking_nsxv3.common.synchronization [None req-10e185d9-aab1-4660-8853-dfca3735c0e9 None None] Enqueued Resource ID: 9ec3864b-0d8a-465b-984a-3ea9b828bf4d with Priority: HIGHEST for action port [ 681.030173] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ec3864b-0d8a-465b-984a-3ea9b828bf4d with Priority: HIGHEST for action port [ 681.030173] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-9ec3864b-0d8a-465b-984a-3ea9b828bf4d taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.030173] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9ec3864b-0d8a-465b-984a-3ea9b828bf4d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.030173] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9ec3864b-0d8a-465b-984a-3ea9b828bf4d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.030959] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9ec3864b-0d8a-465b-984a-3ea9b828bf4d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.030959] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ec3864b-0d8a-465b-984a-3ea9b828bf4d',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.208171] env[65471]: INFO networking_nsxv3.common.synchronization [req-4945111b-ac8e-487a-9e5a-094a9037055a req-997c733b-ec32-47d4-b519-4391e682bc53 tempest-ServerAddressesTestJSON-1658806996 tempest-ServerAddressesTestJSON-1658806996-project-member] Enqueued Resource ID: 453acdc6-7d50-452b-bb4b-66af12a7624a with Priority: HIGHEST for action security_group_members [ 681.209427] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 453acdc6-7d50-452b-bb4b-66af12a7624a with Priority: HIGHEST for action security_group_members [ 681.209726] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-453acdc6-7d50-452b-bb4b-66af12a7624a taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.209881] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-453acdc6-7d50-452b-bb4b-66af12a7624a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.209952] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-453acdc6-7d50-452b-bb4b-66af12a7624a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.210197] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-453acdc6-7d50-452b-bb4b-66af12a7624a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.210379] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.210509] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.210575] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.210806] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.210897] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.211016] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('453acdc6-7d50-452b-bb4b-66af12a7624a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.533681] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9ec3864b-0d8a-465b-984a-3ea9b828bf4d [ 681.533986] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.534162] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.534233] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.534521] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.534691] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.534804] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9ec3864b-0d8a-465b-984a-3ea9b828bf4d already deleted. [ 681.534911] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9ec3864b-0d8a-465b-984a-3ea9b828bf4d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.710429] env[65471]: INFO networking_nsxv3.common.synchronization [req-8c3bd818-7e80-4cf4-91ac-5de13b8e15a5 req-326ae463-77e8-480e-afc8-6dd5cd784fc8 tempest-ServersTestJSON-2129330820 tempest-ServersTestJSON-2129330820-project-member] Enqueued Resource ID: 9164de2f-6b7d-4419-aa70-d088a6c9ab9f with Priority: HIGHEST for action security_group_members [ 681.710429] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9164de2f-6b7d-4419-aa70-d088a6c9ab9f with Priority: HIGHEST for action security_group_members [ 681.716024] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-9164de2f-6b7d-4419-aa70-d088a6c9ab9f taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.716024] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9164de2f-6b7d-4419-aa70-d088a6c9ab9f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.716024] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9164de2f-6b7d-4419-aa70-d088a6c9ab9f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.716024] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9164de2f-6b7d-4419-aa70-d088a6c9ab9f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.716024] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.716024] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.716024] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.720676] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.720676] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.720676] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9164de2f-6b7d-4419-aa70-d088a6c9ab9f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.720676] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.720676] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.720676] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.720676] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.720676] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.720676] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.720676] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.720676] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.720676] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.720676] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.720676] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 453acdc6-7d50-452b-bb4b-66af12a7624a is going to be updated. [ 681.762532] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.762781] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.762847] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.763191] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.763356] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.778290] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 453acdc6-7d50-452b-bb4b-66af12a7624a in Status: IN_PROGRESS for 2s [ 681.841075] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 14a38584-d8ef-4361-b344-b91e376144fa in Status: SUCCESS [ 681.841434] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14a38584-d8ef-4361-b344-b91e376144fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.223508] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.223961] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.223961] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.224136] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.224136] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.224374] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.224432] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.224468] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.224676] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.224743] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.224827] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9164de2f-6b7d-4419-aa70-d088a6c9ab9f already deleted. [ 682.224919] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9164de2f-6b7d-4419-aa70-d088a6c9ab9f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.609024] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ecf6012-bc6c-4512-8d9d-962c10f0cad9 in Status: SUCCESS [ 682.609435] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.609502] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.609802] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.610012] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.610168] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.610251] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.610444] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.610530] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.611144] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.611144] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2ecf6012-bc6c-4512-8d9d-962c10f0cad9',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.649375] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock network-456 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.649775] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "network-456" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.649960] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "network-456" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.650340] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "network-456" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.650676] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.650935] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.651148] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.651609] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.651800] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.655015] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 682.655015] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 682.655015] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 682.655015] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 682.655015] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 682.655015] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 682.655015] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 682.655015] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a9f3871-1bad-4130-b669-97b85ced692d in Status: SUCCESS [ 682.655015] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2a9f3871-1bad-4130-b669-97b85ced692d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.673165] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 682.673409] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 682.673593] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 682.673854] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "network-456" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.674260] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock port-f3ead852-4b28-4e87-a61a-b2c8b97ca58d taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.674503] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "port-f3ead852-4b28-4e87-a61a-b2c8b97ca58d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.674662] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "port-f3ead852-4b28-4e87-a61a-b2c8b97ca58d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.675190] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "port-f3ead852-4b28-4e87-a61a-b2c8b97ca58d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.675406] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3ead852-4b28-4e87-a61a-b2c8b97ca58d',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.114352] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.114352] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.114352] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.114566] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.114665] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.114774] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.114855] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.115013] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.115106] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.115230] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.115950] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.115950] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.115950] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.115950] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.115950] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.115950] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.115950] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.116311] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.116311] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.116388] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.116505] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2ecf6012-bc6c-4512-8d9d-962c10f0cad9',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.178120] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.178406] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.178555] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.178904] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.179132] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.181761] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Segment Port f3ead852-4b28-4e87-a61a-b2c8b97ca58d not found, creating... [ 683.181761] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.181761] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.181761] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.181761] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.181761] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.181761] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.181761] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.181761] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.181761] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.182373] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.182373] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Resource: SegmentPort with ID: f3ead852-4b28-4e87-a61a-b2c8b97ca58d is going to be created. [ 683.206845] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.207129] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.208102] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.208102] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.208102] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.208321] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "port-f3ead852-4b28-4e87-a61a-b2c8b97ca58d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.289442] env[65471]: INFO networking_nsxv3.common.synchronization [None req-e9892577-5737-4a62-9d41-020f7287fdb1 None None] Enqueued Resource ID: 58a09579-a630-44ee-be65-c5f774cf4ff9 with Priority: HIGHEST for action port [ 683.290403] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58a09579-a630-44ee-be65-c5f774cf4ff9 with Priority: HIGHEST for action port [ 683.291027] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-58a09579-a630-44ee-be65-c5f774cf4ff9 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.291027] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-58a09579-a630-44ee-be65-c5f774cf4ff9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.291027] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-58a09579-a630-44ee-be65-c5f774cf4ff9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.291456] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-58a09579-a630-44ee-be65-c5f774cf4ff9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.293194] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58a09579-a630-44ee-be65-c5f774cf4ff9',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.365159] env[65471]: INFO networking_nsxv3.common.synchronization [None req-49ba2ce3-f3e3-4611-a2f9-d40725fcdae3 None None] Enqueued Resource ID: d80e3b1a-5448-4819-a2ae-962ccdb9843c with Priority: HIGHEST for action port [ 683.365628] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d80e3b1a-5448-4819-a2ae-962ccdb9843c with Priority: HIGHEST for action port [ 683.365947] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-d80e3b1a-5448-4819-a2ae-962ccdb9843c taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.366652] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d80e3b1a-5448-4819-a2ae-962ccdb9843c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.367771] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d80e3b1a-5448-4819-a2ae-962ccdb9843c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.367771] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d80e3b1a-5448-4819-a2ae-962ccdb9843c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.367771] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d80e3b1a-5448-4819-a2ae-962ccdb9843c',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.619651] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2ecf6012-bc6c-4512-8d9d-962c10f0cad9: rpc.has_security_group_logging(os_id): False [ 683.644884] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.644884] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.644884] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.644884] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.644884] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.644884] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.644884] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.644884] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.644884] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.644884] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.644884] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.644884] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.644884] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.644884] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.644884] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.645620] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.645620] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.645620] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.645620] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.645620] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.645620] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ecf6012-bc6c-4512-8d9d-962c10f0cad9 is going to be created. [ 683.713385] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.713385] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.713385] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.713385] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.713385] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.730183] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ecf6012-bc6c-4512-8d9d-962c10f0cad9 in Status: IN_PROGRESS for 2s [ 683.798694] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 58a09579-a630-44ee-be65-c5f774cf4ff9 [ 683.798694] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.798694] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.798694] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.798694] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.798694] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.798694] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:58a09579-a630-44ee-be65-c5f774cf4ff9 already deleted. [ 683.798694] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-58a09579-a630-44ee-be65-c5f774cf4ff9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.799228] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 453acdc6-7d50-452b-bb4b-66af12a7624a in Status: SUCCESS [ 683.800761] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 453acdc6-7d50-452b-bb4b-66af12a7624a deletion is rescheduled due to dependency. [ 683.800761] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-453acdc6-7d50-452b-bb4b-66af12a7624a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.871584] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d80e3b1a-5448-4819-a2ae-962ccdb9843c [ 683.871782] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.871935] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.872016] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.872249] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.872352] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.872455] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d80e3b1a-5448-4819-a2ae-962ccdb9843c already deleted. [ 683.872541] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d80e3b1a-5448-4819-a2ae-962ccdb9843c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.077496] env[65471]: INFO networking_nsxv3.common.synchronization [req-8c3bd818-7e80-4cf4-91ac-5de13b8e15a5 req-3fd5df8e-8484-420b-8f73-675afd88ca1b service nova] Enqueued Resource ID: 9164de2f-6b7d-4419-aa70-d088a6c9ab9f with Priority: HIGHEST for action security_group_rules [ 684.078805] env[65471]: INFO networking_nsxv3.common.synchronization [req-8c3bd818-7e80-4cf4-91ac-5de13b8e15a5 req-3fd5df8e-8484-420b-8f73-675afd88ca1b service nova] Enqueued Resource ID: 9164de2f-6b7d-4419-aa70-d088a6c9ab9f with Priority: HIGHEST for action security_group_members [ 684.079372] env[65471]: INFO networking_nsxv3.common.synchronization [req-8c3bd818-7e80-4cf4-91ac-5de13b8e15a5 req-3fd5df8e-8484-420b-8f73-675afd88ca1b service nova] Enqueued Resource ID: f3ead852-4b28-4e87-a61a-b2c8b97ca58d with Priority: HIGHEST for action port [ 684.079902] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9164de2f-6b7d-4419-aa70-d088a6c9ab9f with Priority: HIGHEST for action security_group_rules [ 684.080087] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9164de2f-6b7d-4419-aa70-d088a6c9ab9f with Priority: HIGHEST for action security_group_members [ 684.080210] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3ead852-4b28-4e87-a61a-b2c8b97ca58d with Priority: HIGHEST for action port [ 684.080649] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9164de2f-6b7d-4419-aa70-d088a6c9ab9f taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.080816] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9164de2f-6b7d-4419-aa70-d088a6c9ab9f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.080913] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9164de2f-6b7d-4419-aa70-d088a6c9ab9f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.081103] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9164de2f-6b7d-4419-aa70-d088a6c9ab9f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.081170] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9164de2f-6b7d-4419-aa70-d088a6c9ab9f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.082518] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-9164de2f-6b7d-4419-aa70-d088a6c9ab9f taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.082518] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9164de2f-6b7d-4419-aa70-d088a6c9ab9f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.082518] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9164de2f-6b7d-4419-aa70-d088a6c9ab9f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.082518] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9164de2f-6b7d-4419-aa70-d088a6c9ab9f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.082827] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.082827] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.082827] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.082999] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.082999] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.083112] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9164de2f-6b7d-4419-aa70-d088a6c9ab9f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.083906] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-f3ead852-4b28-4e87-a61a-b2c8b97ca58d taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.084092] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f3ead852-4b28-4e87-a61a-b2c8b97ca58d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.084092] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f3ead852-4b28-4e87-a61a-b2c8b97ca58d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.084235] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f3ead852-4b28-4e87-a61a-b2c8b97ca58d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.084302] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3ead852-4b28-4e87-a61a-b2c8b97ca58d',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.588542] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-9164de2f-6b7d-4419-aa70-d088a6c9ab9f taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.589241] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9164de2f-6b7d-4419-aa70-d088a6c9ab9f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.589570] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9164de2f-6b7d-4419-aa70-d088a6c9ab9f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.591263] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f3ead852-4b28-4e87-a61a-b2c8b97ca58d with status ACTIVE [ 684.591612] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.591880] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.592052] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.592358] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.593453] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.593778] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.594053] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.594211] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.594893] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.595113] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.595408] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.595710] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.595876] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.596133] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.596342] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.596521] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f3ead852-4b28-4e87-a61a-b2c8b97ca58d is going to be updated. [ 684.620329] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.620591] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.620591] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.620832] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.620924] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.621066] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f3ead852-4b28-4e87-a61a-b2c8b97ca58d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.101990] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9164de2f-6b7d-4419-aa70-d088a6c9ab9f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.444375] env[65471]: INFO networking_nsxv3.common.synchronization [req-be6fa93b-e26a-43d1-81e4-c0ee49f0911d req-a2f483dd-a8da-4546-9cd0-cd134e3daff6 tempest-ServerRescueTestJSONUnderV235-906155078 tempest-ServerRescueTestJSONUnderV235-906155078-project-member] Enqueued Resource ID: 7cefc497-117e-45da-bc1f-1ab0ea166d74 with Priority: HIGHEST for action security_group_members [ 685.444565] env[65471]: INFO networking_nsxv3.common.synchronization [req-be6fa93b-e26a-43d1-81e4-c0ee49f0911d req-a2f483dd-a8da-4546-9cd0-cd134e3daff6 tempest-ServerRescueTestJSONUnderV235-906155078 tempest-ServerRescueTestJSONUnderV235-906155078-project-member] Enqueued Resource ID: ea3f0604-cce5-4826-ad44-6963ad4320b0 with Priority: HIGHEST for action security_group_members [ 685.445044] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cefc497-117e-45da-bc1f-1ab0ea166d74 with Priority: HIGHEST for action security_group_members [ 685.445156] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea3f0604-cce5-4826-ad44-6963ad4320b0 with Priority: HIGHEST for action security_group_members [ 685.445425] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cefc497-117e-45da-bc1f-1ab0ea166d74 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.445777] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.445844] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.446418] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.446669] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.446895] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.446895] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.447065] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.447178] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.447239] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7cefc497-117e-45da-bc1f-1ab0ea166d74',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.449123] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea3f0604-cce5-4826-ad44-6963ad4320b0 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.451817] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea3f0604-cce5-4826-ad44-6963ad4320b0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.451817] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea3f0604-cce5-4826-ad44-6963ad4320b0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.451817] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea3f0604-cce5-4826-ad44-6963ad4320b0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.451817] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.451817] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.451817] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.451817] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.452655] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.452655] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea3f0604-cce5-4826-ad44-6963ad4320b0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.516069] env[65471]: INFO networking_nsxv3.common.synchronization [req-be6fa93b-e26a-43d1-81e4-c0ee49f0911d req-a2f483dd-a8da-4546-9cd0-cd134e3daff6 tempest-ServerRescueTestJSONUnderV235-906155078 tempest-ServerRescueTestJSONUnderV235-906155078-project-member] Enqueued Resource ID: 7cefc497-117e-45da-bc1f-1ab0ea166d74 with Priority: HIGHEST for action security_group_rules [ 685.516436] env[65471]: INFO networking_nsxv3.common.synchronization [req-be6fa93b-e26a-43d1-81e4-c0ee49f0911d req-a2f483dd-a8da-4546-9cd0-cd134e3daff6 tempest-ServerRescueTestJSONUnderV235-906155078 tempest-ServerRescueTestJSONUnderV235-906155078-project-member] Enqueued Resource ID: 7cefc497-117e-45da-bc1f-1ab0ea166d74 with Priority: HIGHEST for action security_group_members [ 685.517016] env[65471]: INFO networking_nsxv3.common.synchronization [req-be6fa93b-e26a-43d1-81e4-c0ee49f0911d req-a2f483dd-a8da-4546-9cd0-cd134e3daff6 tempest-ServerRescueTestJSONUnderV235-906155078 tempest-ServerRescueTestJSONUnderV235-906155078-project-member] Enqueued Resource ID: ea3f0604-cce5-4826-ad44-6963ad4320b0 with Priority: HIGHEST for action security_group_rules [ 685.517016] env[65471]: INFO networking_nsxv3.common.synchronization [req-be6fa93b-e26a-43d1-81e4-c0ee49f0911d req-a2f483dd-a8da-4546-9cd0-cd134e3daff6 tempest-ServerRescueTestJSONUnderV235-906155078 tempest-ServerRescueTestJSONUnderV235-906155078-project-member] Enqueued Resource ID: ea3f0604-cce5-4826-ad44-6963ad4320b0 with Priority: HIGHEST for action security_group_members [ 685.517016] env[65471]: INFO networking_nsxv3.common.synchronization [req-be6fa93b-e26a-43d1-81e4-c0ee49f0911d req-a2f483dd-a8da-4546-9cd0-cd134e3daff6 tempest-ServerRescueTestJSONUnderV235-906155078 tempest-ServerRescueTestJSONUnderV235-906155078-project-member] Enqueued Resource ID: e31cbb04-c49d-4616-bb6f-99d8d7f78332 with Priority: HIGHEST for action port [ 685.517762] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cefc497-117e-45da-bc1f-1ab0ea166d74 with Priority: HIGHEST for action security_group_rules [ 685.518033] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea3f0604-cce5-4826-ad44-6963ad4320b0 with Priority: HIGHEST for action security_group_rules [ 685.521021] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e31cbb04-c49d-4616-bb6f-99d8d7f78332 with Priority: HIGHEST for action port [ 685.521021] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cefc497-117e-45da-bc1f-1ab0ea166d74 with Priority: HIGHEST for action security_group_members [ 685.521021] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea3f0604-cce5-4826-ad44-6963ad4320b0 with Priority: HIGHEST for action security_group_members [ 685.521021] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7cefc497-117e-45da-bc1f-1ab0ea166d74 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.521021] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.521021] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.521021] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.521021] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7cefc497-117e-45da-bc1f-1ab0ea166d74',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.521021] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ea3f0604-cce5-4826-ad44-6963ad4320b0 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.521021] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ea3f0604-cce5-4826-ad44-6963ad4320b0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.521021] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ea3f0604-cce5-4826-ad44-6963ad4320b0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.521021] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ea3f0604-cce5-4826-ad44-6963ad4320b0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.521021] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ea3f0604-cce5-4826-ad44-6963ad4320b0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.523428] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-e31cbb04-c49d-4616-bb6f-99d8d7f78332 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.523714] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e31cbb04-c49d-4616-bb6f-99d8d7f78332" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.523885] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e31cbb04-c49d-4616-bb6f-99d8d7f78332" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.524156] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e31cbb04-c49d-4616-bb6f-99d8d7f78332" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.524339] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e31cbb04-c49d-4616-bb6f-99d8d7f78332',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.525865] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cefc497-117e-45da-bc1f-1ab0ea166d74 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.525865] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.526126] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea3f0604-cce5-4826-ad44-6963ad4320b0 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.527017] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea3f0604-cce5-4826-ad44-6963ad4320b0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.602229] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.602229] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.602775] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.602775] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.602775] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.602775] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9164de2f-6b7d-4419-aa70-d088a6c9ab9f is going to be created. [ 685.632024] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.632024] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.632024] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.632024] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.632024] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.641928] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9164de2f-6b7d-4419-aa70-d088a6c9ab9f in Status: UNINITIALIZED for 2s [ 685.746427] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ecf6012-bc6c-4512-8d9d-962c10f0cad9 in Status: SUCCESS [ 685.746684] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.954591] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7cefc497-117e-45da-bc1f-1ab0ea166d74',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.955607] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ea3f0604-cce5-4826-ad44-6963ad4320b0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.030474] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e31cbb04-c49d-4616-bb6f-99d8d7f78332 with status ACTIVE [ 686.030474] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.030474] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.030474] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.030474] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.030474] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.030474] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.030474] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.030474] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.030474] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.030474] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.030474] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.030474] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.030474] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.030474] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.030474] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.030474] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e31cbb04-c49d-4616-bb6f-99d8d7f78332 is going to be updated. [ 686.032244] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea3f0604-cce5-4826-ad44-6963ad4320b0 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.032571] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea3f0604-cce5-4826-ad44-6963ad4320b0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.032931] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cefc497-117e-45da-bc1f-1ab0ea166d74 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.033196] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.059354] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.059354] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.059354] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.059354] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.059354] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.059354] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e31cbb04-c49d-4616-bb6f-99d8d7f78332" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.457527] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7cefc497-117e-45da-bc1f-1ab0ea166d74',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.461746] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ea3f0604-cce5-4826-ad44-6963ad4320b0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.963479] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.963795] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.963795] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.964105] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.964226] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.964338] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7cefc497-117e-45da-bc1f-1ab0ea166d74 is going to be updated. [ 686.967844] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.968282] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.968282] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.968437] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.968549] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.969843] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea3f0604-cce5-4826-ad44-6963ad4320b0 is going to be created. [ 687.017237] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.017416] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.017888] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.018153] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.018462] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.032935] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.033201] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.033323] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.033651] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.033860] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.049448] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea3f0604-cce5-4826-ad44-6963ad4320b0 in Status: UNINITIALIZED for 2s [ 687.050450] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cefc497-117e-45da-bc1f-1ab0ea166d74 in Status: IN_PROGRESS for 2s [ 687.100752] env[65471]: INFO networking_nsxv3.common.synchronization [None req-008033e4-9ecb-4a84-8bb6-74c483bb1acc None None] Enqueued Resource ID: 0c14947a-0126-4d1c-bcf9-35a5fdad4025 with Priority: HIGHEST for action port [ 687.102092] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c14947a-0126-4d1c-bcf9-35a5fdad4025 with Priority: HIGHEST for action port [ 687.102092] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-0c14947a-0126-4d1c-bcf9-35a5fdad4025 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.102092] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0c14947a-0126-4d1c-bcf9-35a5fdad4025" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.103047] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0c14947a-0126-4d1c-bcf9-35a5fdad4025" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.103047] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0c14947a-0126-4d1c-bcf9-35a5fdad4025" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.103047] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c14947a-0126-4d1c-bcf9-35a5fdad4025',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.607461] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0c14947a-0126-4d1c-bcf9-35a5fdad4025 [ 687.607781] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.607931] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.608707] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.609031] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.609095] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.609186] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0c14947a-0126-4d1c-bcf9-35a5fdad4025 already deleted. [ 687.609413] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0c14947a-0126-4d1c-bcf9-35a5fdad4025" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.656150] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9164de2f-6b7d-4419-aa70-d088a6c9ab9f in Status: SUCCESS [ 687.657015] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9164de2f-6b7d-4419-aa70-d088a6c9ab9f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.657015] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9164de2f-6b7d-4419-aa70-d088a6c9ab9f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.657015] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9164de2f-6b7d-4419-aa70-d088a6c9ab9f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.657232] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.657232] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.657386] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.659620] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.659620] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.659620] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9164de2f-6b7d-4419-aa70-d088a6c9ab9f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.659620] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9164de2f-6b7d-4419-aa70-d088a6c9ab9f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.160214] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9164de2f-6b7d-4419-aa70-d088a6c9ab9f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.662705] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9164de2f-6b7d-4419-aa70-d088a6c9ab9f: rpc.has_security_group_logging(os_id): False [ 688.681744] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.682100] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.682234] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.682473] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.682574] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.682821] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.682941] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.683016] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.683251] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.683379] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.683524] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9164de2f-6b7d-4419-aa70-d088a6c9ab9f is going to be created. [ 688.756730] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.756988] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.757129] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.757451] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.757767] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.771943] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9164de2f-6b7d-4419-aa70-d088a6c9ab9f in Status: IN_PROGRESS for 2s [ 689.066575] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cefc497-117e-45da-bc1f-1ab0ea166d74 in Status: SUCCESS [ 689.066575] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.066575] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.066575] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.066575] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.066575] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.066575] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.066575] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.066575] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.066575] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7cefc497-117e-45da-bc1f-1ab0ea166d74',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.071168] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea3f0604-cce5-4826-ad44-6963ad4320b0 in Status: SUCCESS [ 689.071168] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea3f0604-cce5-4826-ad44-6963ad4320b0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.071168] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea3f0604-cce5-4826-ad44-6963ad4320b0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.071168] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea3f0604-cce5-4826-ad44-6963ad4320b0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.071168] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.071168] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.071168] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.071168] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.071168] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.071168] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea3f0604-cce5-4826-ad44-6963ad4320b0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.577012] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7cefc497-117e-45da-bc1f-1ab0ea166d74',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.578205] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ea3f0604-cce5-4826-ad44-6963ad4320b0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.080168] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7cefc497-117e-45da-bc1f-1ab0ea166d74',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.081282] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ea3f0604-cce5-4826-ad44-6963ad4320b0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.394820] env[65471]: INFO networking_nsxv3.common.synchronization [None req-5e3596e2-ce50-481e-9b70-828b02c3fb39 None None] Enqueued Resource ID: 527890b7-f27f-404c-b9d7-12fe4583609d with Priority: HIGHEST for action port [ 690.395488] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 527890b7-f27f-404c-b9d7-12fe4583609d with Priority: HIGHEST for action port [ 690.396632] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-527890b7-f27f-404c-b9d7-12fe4583609d taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.396632] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-527890b7-f27f-404c-b9d7-12fe4583609d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.396632] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-527890b7-f27f-404c-b9d7-12fe4583609d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.396632] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-527890b7-f27f-404c-b9d7-12fe4583609d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.396632] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('527890b7-f27f-404c-b9d7-12fe4583609d',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.583116] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.583645] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.583645] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.583645] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.583645] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.583850] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7cefc497-117e-45da-bc1f-1ab0ea166d74 is going to be updated. [ 690.585021] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.587291] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.587414] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.587546] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.587633] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.587725] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea3f0604-cce5-4826-ad44-6963ad4320b0 is going to be updated. [ 690.620200] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.620327] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.620397] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.620621] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.620870] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.622598] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.622724] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.622768] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.623081] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.623081] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.637358] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cefc497-117e-45da-bc1f-1ab0ea166d74 in Status: IN_PROGRESS for 2s [ 690.638154] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea3f0604-cce5-4826-ad44-6963ad4320b0 in Status: IN_PROGRESS for 2s [ 690.786767] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9164de2f-6b7d-4419-aa70-d088a6c9ab9f in Status: SUCCESS [ 690.787024] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9164de2f-6b7d-4419-aa70-d088a6c9ab9f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.899123] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 527890b7-f27f-404c-b9d7-12fe4583609d [ 690.899485] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.899638] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.899725] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.900145] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.900259] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.900351] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:527890b7-f27f-404c-b9d7-12fe4583609d already deleted. [ 690.900453] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-527890b7-f27f-404c-b9d7-12fe4583609d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.047214] env[65471]: INFO networking_nsxv3.common.synchronization [req-51b48798-28ce-4ada-90ef-314d1689b72e req-e285d762-0d65-4b81-8eae-2d0e4d8759e2 tempest-ListServersNegativeTestJSON-604387842 tempest-ListServersNegativeTestJSON-604387842-project-member] Enqueued Resource ID: 15cae89a-6005-4f02-95eb-d04ef2f8ea8e with Priority: HIGHEST for action security_group_members [ 691.048142] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15cae89a-6005-4f02-95eb-d04ef2f8ea8e with Priority: HIGHEST for action security_group_members [ 691.050309] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.050309] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.050309] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.050309] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.050309] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.050309] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.050309] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.050309] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.050743] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.050743] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15cae89a-6005-4f02-95eb-d04ef2f8ea8e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.234607] env[65471]: INFO networking_nsxv3.common.synchronization [req-9531a052-445d-4d45-8f64-2d454c82cb58 req-64ee2b55-62e5-4258-809e-cf99f5763090 tempest-ServerRescueTestJSONUnderV235-906155078 tempest-ServerRescueTestJSONUnderV235-906155078-project-member] Enqueued Resource ID: 7cefc497-117e-45da-bc1f-1ab0ea166d74 with Priority: HIGHEST for action security_group_members [ 691.234790] env[65471]: INFO networking_nsxv3.common.synchronization [req-9531a052-445d-4d45-8f64-2d454c82cb58 req-64ee2b55-62e5-4258-809e-cf99f5763090 tempest-ServerRescueTestJSONUnderV235-906155078 tempest-ServerRescueTestJSONUnderV235-906155078-project-member] Enqueued Resource ID: ea3f0604-cce5-4826-ad44-6963ad4320b0 with Priority: HIGHEST for action security_group_members [ 691.235414] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cefc497-117e-45da-bc1f-1ab0ea166d74 with Priority: HIGHEST for action security_group_members [ 691.235903] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea3f0604-cce5-4826-ad44-6963ad4320b0 with Priority: HIGHEST for action security_group_members [ 691.235903] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cefc497-117e-45da-bc1f-1ab0ea166d74 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.236090] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.240018] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea3f0604-cce5-4826-ad44-6963ad4320b0 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.240018] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea3f0604-cce5-4826-ad44-6963ad4320b0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.287787] env[65471]: INFO networking_nsxv3.common.synchronization [req-9531a052-445d-4d45-8f64-2d454c82cb58 req-64ee2b55-62e5-4258-809e-cf99f5763090 tempest-ServerRescueTestJSONUnderV235-906155078 tempest-ServerRescueTestJSONUnderV235-906155078-project-member] Enqueued Resource ID: 7cefc497-117e-45da-bc1f-1ab0ea166d74 with Priority: HIGHEST for action security_group_rules [ 691.287787] env[65471]: INFO networking_nsxv3.common.synchronization [req-9531a052-445d-4d45-8f64-2d454c82cb58 req-64ee2b55-62e5-4258-809e-cf99f5763090 tempest-ServerRescueTestJSONUnderV235-906155078 tempest-ServerRescueTestJSONUnderV235-906155078-project-member] Enqueued Resource ID: 7cefc497-117e-45da-bc1f-1ab0ea166d74 with Priority: HIGHEST for action security_group_members [ 691.287946] env[65471]: INFO networking_nsxv3.common.synchronization [req-9531a052-445d-4d45-8f64-2d454c82cb58 req-64ee2b55-62e5-4258-809e-cf99f5763090 tempest-ServerRescueTestJSONUnderV235-906155078 tempest-ServerRescueTestJSONUnderV235-906155078-project-member] Enqueued Resource ID: e31cbb04-c49d-4616-bb6f-99d8d7f78332 with Priority: HIGHEST for action port [ 691.289051] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cefc497-117e-45da-bc1f-1ab0ea166d74 with Priority: HIGHEST for action security_group_rules [ 691.289051] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cefc497-117e-45da-bc1f-1ab0ea166d74 with Priority: HIGHEST for action security_group_members [ 691.289051] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e31cbb04-c49d-4616-bb6f-99d8d7f78332 with Priority: HIGHEST for action port [ 691.290215] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7cefc497-117e-45da-bc1f-1ab0ea166d74 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.290215] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.290766] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cefc497-117e-45da-bc1f-1ab0ea166d74 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.290876] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.291096] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-e31cbb04-c49d-4616-bb6f-99d8d7f78332 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.291204] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e31cbb04-c49d-4616-bb6f-99d8d7f78332" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.291271] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e31cbb04-c49d-4616-bb6f-99d8d7f78332" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.291479] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e31cbb04-c49d-4616-bb6f-99d8d7f78332" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.291564] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e31cbb04-c49d-4616-bb6f-99d8d7f78332',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.552695] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.552695] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.552943] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.554053] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.554053] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.554324] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.554475] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.554967] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.555321] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.555708] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.555708] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15cae89a-6005-4f02-95eb-d04ef2f8ea8e already deleted. [ 691.555708] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.679976] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock network-353 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.680423] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "network-353" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.680423] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "network-353" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.681528] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "network-353" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.681778] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.682015] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.682212] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.682631] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.686078] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.686394] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 691.686519] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 691.686627] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 691.686728] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 691.686835] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 691.686932] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 691.687073] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 691.712708] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 691.712894] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 691.713095] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 691.713267] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "network-353" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.713609] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock port-3878cf10-520c-4129-b14c-1ea1023ee356 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.713778] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "port-3878cf10-520c-4129-b14c-1ea1023ee356" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.713918] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "port-3878cf10-520c-4129-b14c-1ea1023ee356" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.714300] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "port-3878cf10-520c-4129-b14c-1ea1023ee356" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.714459] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3878cf10-520c-4129-b14c-1ea1023ee356',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.794907] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e31cbb04-c49d-4616-bb6f-99d8d7f78332 with status ACTIVE [ 691.795260] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.795462] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.795559] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.795785] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.795888] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.796086] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.796183] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.796237] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.796393] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.796489] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.796680] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.796761] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.796824] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.797499] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.797499] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.797499] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e31cbb04-c49d-4616-bb6f-99d8d7f78332 is going to be updated. [ 691.825729] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.825896] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.825977] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.826246] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.826451] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.826638] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e31cbb04-c49d-4616-bb6f-99d8d7f78332" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.223031] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.223031] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.223031] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.223031] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.223031] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.223031] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Segment Port 3878cf10-520c-4129-b14c-1ea1023ee356 not found, creating... [ 692.223031] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.223031] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.223031] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.223031] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.223031] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.223602] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.223602] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.223602] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.223602] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.223602] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.223602] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Resource: SegmentPort with ID: 3878cf10-520c-4129-b14c-1ea1023ee356 is going to be created. [ 692.252721] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.253009] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.253160] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.253426] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.253649] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.253877] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "port-3878cf10-520c-4129-b14c-1ea1023ee356" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.648756] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cefc497-117e-45da-bc1f-1ab0ea166d74 in Status: SUCCESS [ 692.648992] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.649189] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.649425] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.649671] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.649800] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.649800] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.649971] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.650068] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.650156] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.650258] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7cefc497-117e-45da-bc1f-1ab0ea166d74',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.651832] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea3f0604-cce5-4826-ad44-6963ad4320b0 in Status: SUCCESS [ 692.652075] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea3f0604-cce5-4826-ad44-6963ad4320b0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.652279] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.652483] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.652684] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.652819] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.652911] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.653470] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.653607] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.653727] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7cefc497-117e-45da-bc1f-1ab0ea166d74',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.654537] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea3f0604-cce5-4826-ad44-6963ad4320b0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.654754] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea3f0604-cce5-4826-ad44-6963ad4320b0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.654959] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.655316] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.655437] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.656362] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.656478] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.658393] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea3f0604-cce5-4826-ad44-6963ad4320b0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.658521] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ea3f0604-cce5-4826-ad44-6963ad4320b0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.659599] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea3f0604-cce5-4826-ad44-6963ad4320b0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.659833] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea3f0604-cce5-4826-ad44-6963ad4320b0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.659957] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.660083] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.660141] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.660309] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.660616] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.660616] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea3f0604-cce5-4826-ad44-6963ad4320b0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.992258] env[65471]: INFO networking_nsxv3.common.synchronization [req-51b48798-28ce-4ada-90ef-314d1689b72e req-ad459cb2-8f01-4a92-a33c-1a1b0e2181c5 service nova] Enqueued Resource ID: 15cae89a-6005-4f02-95eb-d04ef2f8ea8e with Priority: HIGHEST for action security_group_rules [ 692.992258] env[65471]: INFO networking_nsxv3.common.synchronization [req-51b48798-28ce-4ada-90ef-314d1689b72e req-ad459cb2-8f01-4a92-a33c-1a1b0e2181c5 service nova] Enqueued Resource ID: 15cae89a-6005-4f02-95eb-d04ef2f8ea8e with Priority: HIGHEST for action security_group_members [ 692.992258] env[65471]: INFO networking_nsxv3.common.synchronization [req-51b48798-28ce-4ada-90ef-314d1689b72e req-ad459cb2-8f01-4a92-a33c-1a1b0e2181c5 service nova] Enqueued Resource ID: 3878cf10-520c-4129-b14c-1ea1023ee356 with Priority: HIGHEST for action port [ 692.992258] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15cae89a-6005-4f02-95eb-d04ef2f8ea8e with Priority: HIGHEST for action security_group_rules [ 692.992258] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15cae89a-6005-4f02-95eb-d04ef2f8ea8e with Priority: HIGHEST for action security_group_members [ 692.992258] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3878cf10-520c-4129-b14c-1ea1023ee356 with Priority: HIGHEST for action port [ 692.992258] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15cae89a-6005-4f02-95eb-d04ef2f8ea8e taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.992736] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.992736] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.992893] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.992985] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15cae89a-6005-4f02-95eb-d04ef2f8ea8e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.993914] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.994068] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.994142] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.994298] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.994440] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.994543] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.994597] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.994718] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.994801] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.994891] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15cae89a-6005-4f02-95eb-d04ef2f8ea8e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.995721] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-3878cf10-520c-4129-b14c-1ea1023ee356 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.995828] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3878cf10-520c-4129-b14c-1ea1023ee356" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.995877] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3878cf10-520c-4129-b14c-1ea1023ee356" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.996679] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3878cf10-520c-4129-b14c-1ea1023ee356" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.996679] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3878cf10-520c-4129-b14c-1ea1023ee356',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.094690] env[65471]: INFO networking_nsxv3.common.synchronization [None req-a42c2a1b-00b4-4a25-9a19-65a1af621fef None None] Enqueued Resource ID: 9c771c33-0d6b-4a48-b636-7b13271ee6d5 with Priority: HIGHEST for action port [ 693.094690] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c771c33-0d6b-4a48-b636-7b13271ee6d5 with Priority: HIGHEST for action port [ 693.094690] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-9c771c33-0d6b-4a48-b636-7b13271ee6d5 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.094690] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9c771c33-0d6b-4a48-b636-7b13271ee6d5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.094690] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9c771c33-0d6b-4a48-b636-7b13271ee6d5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.094690] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9c771c33-0d6b-4a48-b636-7b13271ee6d5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.094690] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c771c33-0d6b-4a48-b636-7b13271ee6d5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.160346] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7cefc497-117e-45da-bc1f-1ab0ea166d74',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.162092] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cefc497-117e-45da-bc1f-1ab0ea166d74 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.162092] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.162344] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ea3f0604-cce5-4826-ad44-6963ad4320b0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.163174] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.163415] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.163415] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.163643] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.163757] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.164344] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.164589] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.164589] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.164927] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.164927] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.164927] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea3f0604-cce5-4826-ad44-6963ad4320b0 is going to be deleted. [ 693.264792] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.264792] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.264792] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.264792] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.264792] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.264792] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea3f0604-cce5-4826-ad44-6963ad4320b0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.501876] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3878cf10-520c-4129-b14c-1ea1023ee356 with status ACTIVE [ 693.501876] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.501876] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.501876] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.501876] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.501876] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.501876] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.501876] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.501876] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.501876] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.501876] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.501876] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.501876] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.501876] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.501876] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.501876] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.501876] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3878cf10-520c-4129-b14c-1ea1023ee356 is going to be updated. [ 693.503554] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15cae89a-6005-4f02-95eb-d04ef2f8ea8e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.504577] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.504732] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.547508] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.547508] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.547508] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.547892] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.547892] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.548086] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3878cf10-520c-4129-b14c-1ea1023ee356" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.596230] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9c771c33-0d6b-4a48-b636-7b13271ee6d5 [ 693.596476] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.596608] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.596678] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.596893] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.597007] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.597096] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9c771c33-0d6b-4a48-b636-7b13271ee6d5 already deleted. [ 693.597212] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9c771c33-0d6b-4a48-b636-7b13271ee6d5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.665869] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7cefc497-117e-45da-bc1f-1ab0ea166d74',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.666932] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ea3f0604-cce5-4826-ad44-6963ad4320b0: rpc.has_security_group_logging(os_id): False [ 693.705415] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.706387] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.706387] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.706720] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.706720] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.707134] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.707431] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.707431] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.707688] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.707814] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.707967] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ea3f0604-cce5-4826-ad44-6963ad4320b0 is going to be created. [ 693.752732] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/ea3f0604-cce5-4826-ad44-6963ad4320b0], does not exist path=[/infra/domains/default/groups/ea3f0604-cce5-4826-ad44-6963ad4320b0]."\n}' [ 693.752883] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ea3f0604-cce5-4826-ad44-6963ad4320b0 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/ea3f0604-cce5-4826-ad44-6963ad4320b0 [ 693.752963] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 693.785639] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.785776] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.785844] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.786061] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.788518] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.788823] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.788964] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.789079] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.789486] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.790285] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.790285] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.790285] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.790285] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.790285] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.790555] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.790555] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ea3f0604-cce5-4826-ad44-6963ad4320b0 is going to be created. [ 693.825953] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/ea3f0604-cce5-4826-ad44-6963ad4320b0], does not exist path=[/infra/domains/default/groups/ea3f0604-cce5-4826-ad44-6963ad4320b0]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/ea3f0604-cce5-4826-ad44-6963ad4320b0 [ 693.826110] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ea3f0604-cce5-4826-ad44-6963ad4320b0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.826659] env[65471]: Traceback (most recent call last): [ 693.826747] env[65471]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 693.826747] env[65471]: return func(*args, **kwargs) [ 693.826747] env[65471]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 693.826747] env[65471]: res.raise_for_status() [ 693.826747] env[65471]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 693.826747] env[65471]: raise HTTPError(http_error_msg, response=self) [ 693.826747] env[65471]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/ea3f0604-cce5-4826-ad44-6963ad4320b0 [ 693.826747] env[65471]: During handling of the above exception, another exception occurred: [ 693.826747] env[65471]: Traceback (most recent call last): [ 693.826747] env[65471]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 693.826747] env[65471]: listener.cb(fileno) [ 693.826747] env[65471]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 693.826747] env[65471]: result = function(*args, **kwargs) [ 693.826747] env[65471]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 693.826747] env[65471]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 693.826747] env[65471]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 693.826747] env[65471]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 693.826747] env[65471]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 693.826747] env[65471]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 693.826747] env[65471]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 693.826747] env[65471]: res.raise_for_status() [ 693.826747] env[65471]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 693.826747] env[65471]: raise HTTPError(http_error_msg, response=self) [ 693.826747] env[65471]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/ea3f0604-cce5-4826-ad44-6963ad4320b0 [ 693.826747] env[65471]: Removing descriptor: 5 [ 694.006405] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15cae89a-6005-4f02-95eb-d04ef2f8ea8e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.173184] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.173320] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.173320] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.173555] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.173667] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.173876] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7cefc497-117e-45da-bc1f-1ab0ea166d74 is going to be updated. [ 694.210462] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.210661] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.210711] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.210964] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.211093] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.221912] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cefc497-117e-45da-bc1f-1ab0ea166d74 in Status: IN_PROGRESS for 2s [ 694.492878] env[65471]: INFO networking_nsxv3.common.synchronization [req-51b48798-28ce-4ada-90ef-314d1689b72e req-7497f044-cbf2-4e96-8da7-dd15f7c12bcb tempest-ListServersNegativeTestJSON-604387842 tempest-ListServersNegativeTestJSON-604387842-project-member] Enqueued Resource ID: 15cae89a-6005-4f02-95eb-d04ef2f8ea8e with Priority: HIGHEST for action security_group_members [ 694.493726] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15cae89a-6005-4f02-95eb-d04ef2f8ea8e with Priority: HIGHEST for action security_group_members [ 694.494095] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.494199] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.510059] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.510305] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.510417] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.510764] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.511341] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.511341] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15cae89a-6005-4f02-95eb-d04ef2f8ea8e is going to be created. [ 694.540378] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.541215] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.541393] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.541828] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.542125] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.559182] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15cae89a-6005-4f02-95eb-d04ef2f8ea8e in Status: UNINITIALIZED for 2s [ 695.047842] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock network-353 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.048249] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "network-353" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.048249] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "network-353" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.048477] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "network-353" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.048754] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.048940] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.049071] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.049281] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.049417] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.049637] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 695.049718] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 695.049855] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 695.049969] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 695.050087] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 695.050185] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 695.050318] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 695.074413] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 695.074526] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 695.074721] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 695.074891] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "network-353" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.075303] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock port-726063a7-0f0b-4f39-96e2-46680eccf650 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.075499] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "port-726063a7-0f0b-4f39-96e2-46680eccf650" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.075568] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "port-726063a7-0f0b-4f39-96e2-46680eccf650" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.075866] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "port-726063a7-0f0b-4f39-96e2-46680eccf650" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.076007] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('726063a7-0f0b-4f39-96e2-46680eccf650',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.579738] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.580012] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.580147] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.580456] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.580596] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.580749] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Segment Port 726063a7-0f0b-4f39-96e2-46680eccf650 not found, creating... [ 695.581025] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.581170] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.581271] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.581491] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.581619] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.581897] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.582055] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.582213] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.582401] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.582526] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.582656] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Resource: SegmentPort with ID: 726063a7-0f0b-4f39-96e2-46680eccf650 is going to be created. [ 695.606141] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.606414] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.606483] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.606784] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.606957] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.607190] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "port-726063a7-0f0b-4f39-96e2-46680eccf650" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.233689] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cefc497-117e-45da-bc1f-1ab0ea166d74 in Status: IN_PROGRESS for 4s [ 696.352250] env[65471]: INFO networking_nsxv3.common.synchronization [req-51b48798-28ce-4ada-90ef-314d1689b72e req-de9a2a0e-a9a2-415f-9cd4-fae0f729b0ad service nova] Enqueued Resource ID: 15cae89a-6005-4f02-95eb-d04ef2f8ea8e with Priority: HIGHEST for action security_group_rules [ 696.352355] env[65471]: INFO networking_nsxv3.common.synchronization [req-51b48798-28ce-4ada-90ef-314d1689b72e req-de9a2a0e-a9a2-415f-9cd4-fae0f729b0ad service nova] Enqueued Resource ID: 15cae89a-6005-4f02-95eb-d04ef2f8ea8e with Priority: HIGHEST for action security_group_members [ 696.352472] env[65471]: INFO networking_nsxv3.common.synchronization [req-51b48798-28ce-4ada-90ef-314d1689b72e req-de9a2a0e-a9a2-415f-9cd4-fae0f729b0ad service nova] Enqueued Resource ID: 726063a7-0f0b-4f39-96e2-46680eccf650 with Priority: HIGHEST for action port [ 696.353052] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15cae89a-6005-4f02-95eb-d04ef2f8ea8e with Priority: HIGHEST for action security_group_rules [ 696.353228] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15cae89a-6005-4f02-95eb-d04ef2f8ea8e with Priority: HIGHEST for action security_group_members [ 696.353340] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 726063a7-0f0b-4f39-96e2-46680eccf650 with Priority: HIGHEST for action port [ 696.353744] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15cae89a-6005-4f02-95eb-d04ef2f8ea8e taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.353871] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.354372] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.354512] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.354865] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-726063a7-0f0b-4f39-96e2-46680eccf650 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.355043] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-726063a7-0f0b-4f39-96e2-46680eccf650" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.355167] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-726063a7-0f0b-4f39-96e2-46680eccf650" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.355310] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-726063a7-0f0b-4f39-96e2-46680eccf650" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.355574] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('726063a7-0f0b-4f39-96e2-46680eccf650',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.569783] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15cae89a-6005-4f02-95eb-d04ef2f8ea8e in Status: SUCCESS [ 696.573031] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.573031] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.573031] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.573031] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.573031] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.573031] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.573031] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.573031] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.573031] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.573031] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('15cae89a-6005-4f02-95eb-d04ef2f8ea8e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.573031] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.573031] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.576851] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.576851] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.576851] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.576851] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.579223] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.579223] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15cae89a-6005-4f02-95eb-d04ef2f8ea8e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.626216] env[65471]: INFO networking_nsxv3.common.synchronization [None req-701521b8-4702-4046-8125-69dbb3c5026e None None] Enqueued Resource ID: 5aaf8d91-f4da-4e70-90ed-7fefd63f7aa6 with Priority: HIGHEST for action port [ 696.626756] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5aaf8d91-f4da-4e70-90ed-7fefd63f7aa6 with Priority: HIGHEST for action port [ 696.627244] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-5aaf8d91-f4da-4e70-90ed-7fefd63f7aa6 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.627356] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5aaf8d91-f4da-4e70-90ed-7fefd63f7aa6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.627414] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5aaf8d91-f4da-4e70-90ed-7fefd63f7aa6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.627885] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5aaf8d91-f4da-4e70-90ed-7fefd63f7aa6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.627991] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5aaf8d91-f4da-4e70-90ed-7fefd63f7aa6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.857570] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 726063a7-0f0b-4f39-96e2-46680eccf650 with status ACTIVE [ 696.857907] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.858133] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.858259] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.858536] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.858676] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.858921] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.859039] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.859102] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.859264] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.859343] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.859548] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.859642] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.859712] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.860035] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.860035] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.860183] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 726063a7-0f0b-4f39-96e2-46680eccf650 is going to be updated. [ 696.887499] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.887722] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.887790] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.890093] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.890093] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.890093] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-726063a7-0f0b-4f39-96e2-46680eccf650" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.082595] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.082595] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.082595] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15cae89a-6005-4f02-95eb-d04ef2f8ea8e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.133607] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5aaf8d91-f4da-4e70-90ed-7fefd63f7aa6 [ 697.133876] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.136083] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.136083] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.136083] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.136083] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.136083] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5aaf8d91-f4da-4e70-90ed-7fefd63f7aa6 already deleted. [ 697.136083] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5aaf8d91-f4da-4e70-90ed-7fefd63f7aa6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.539134] env[65471]: INFO networking_nsxv3.common.synchronization [req-51b48798-28ce-4ada-90ef-314d1689b72e req-3485172e-872f-4cfa-9421-b59e1b35d22f tempest-ListServersNegativeTestJSON-604387842 tempest-ListServersNegativeTestJSON-604387842-project-member] Enqueued Resource ID: 15cae89a-6005-4f02-95eb-d04ef2f8ea8e with Priority: HIGHEST for action security_group_members [ 697.539134] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15cae89a-6005-4f02-95eb-d04ef2f8ea8e with Priority: HIGHEST for action security_group_members [ 697.539517] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.539517] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.586315] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15cae89a-6005-4f02-95eb-d04ef2f8ea8e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.090543] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.090877] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.091056] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.091772] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.091772] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.091772] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15cae89a-6005-4f02-95eb-d04ef2f8ea8e is going to be updated. [ 698.128628] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.128628] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.128628] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.128628] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.128628] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.140497] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15cae89a-6005-4f02-95eb-d04ef2f8ea8e in Status: IN_PROGRESS for 2s [ 698.245838] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cefc497-117e-45da-bc1f-1ab0ea166d74 in Status: SUCCESS [ 698.245838] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.245838] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.245838] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.245838] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.245838] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.245838] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.245838] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.245838] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.246389] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7cefc497-117e-45da-bc1f-1ab0ea166d74',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.567038] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock network-353 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.567489] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "network-353" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.567489] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "network-353" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.567808] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "network-353" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.571076] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.571076] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.571076] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.571076] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.571076] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.571076] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 698.571076] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 698.571076] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 698.571076] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 698.571076] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 698.571076] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 698.571076] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 698.590441] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 698.590577] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 698.590803] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 698.590912] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "network-353" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.591613] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock port-7519415c-ba4c-4d51-bee9-ff34248bd954 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.591793] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "port-7519415c-ba4c-4d51-bee9-ff34248bd954" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.591909] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "port-7519415c-ba4c-4d51-bee9-ff34248bd954" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.592559] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "port-7519415c-ba4c-4d51-bee9-ff34248bd954" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.592934] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7519415c-ba4c-4d51-bee9-ff34248bd954',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.700443] env[65471]: INFO networking_nsxv3.common.synchronization [None req-77c91440-a930-40d9-9834-94e6cf95ef1e None None] Enqueued Resource ID: 0290db9d-f660-48b7-a55d-5539603ef4ad with Priority: HIGHEST for action port [ 698.700614] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0290db9d-f660-48b7-a55d-5539603ef4ad with Priority: HIGHEST for action port [ 698.700985] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-0290db9d-f660-48b7-a55d-5539603ef4ad taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.701146] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0290db9d-f660-48b7-a55d-5539603ef4ad" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.701259] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0290db9d-f660-48b7-a55d-5539603ef4ad" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.701789] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0290db9d-f660-48b7-a55d-5539603ef4ad" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.701891] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0290db9d-f660-48b7-a55d-5539603ef4ad',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.748309] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7cefc497-117e-45da-bc1f-1ab0ea166d74',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.096454] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.096760] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.096884] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.097190] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.097331] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.097481] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Segment Port 7519415c-ba4c-4d51-bee9-ff34248bd954 not found, creating... [ 699.097734] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.097893] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.097998] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.098216] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.098342] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.098639] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.098788] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.098990] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.099262] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.099488] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.099680] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Resource: SegmentPort with ID: 7519415c-ba4c-4d51-bee9-ff34248bd954 is going to be created. [ 699.125462] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.125700] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.125785] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.126126] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.126298] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.126598] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "port-7519415c-ba4c-4d51-bee9-ff34248bd954" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.204596] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0290db9d-f660-48b7-a55d-5539603ef4ad [ 699.204781] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.204849] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.204888] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.205153] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.205249] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.205304] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0290db9d-f660-48b7-a55d-5539603ef4ad already deleted. [ 699.205390] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0290db9d-f660-48b7-a55d-5539603ef4ad" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.250632] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7cefc497-117e-45da-bc1f-1ab0ea166d74',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.756830] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.756830] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.756830] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.757352] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.757352] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.757352] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7cefc497-117e-45da-bc1f-1ab0ea166d74 is going to be updated. [ 699.788696] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.788859] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.788911] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.789159] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.790046] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.799788] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cefc497-117e-45da-bc1f-1ab0ea166d74 in Status: IN_PROGRESS for 2s [ 699.900256] env[65471]: INFO networking_nsxv3.common.synchronization [req-51b48798-28ce-4ada-90ef-314d1689b72e req-7e218b63-0abb-4305-a69b-ee344c59febb service nova] Enqueued Resource ID: 15cae89a-6005-4f02-95eb-d04ef2f8ea8e with Priority: HIGHEST for action security_group_rules [ 699.900256] env[65471]: INFO networking_nsxv3.common.synchronization [req-51b48798-28ce-4ada-90ef-314d1689b72e req-7e218b63-0abb-4305-a69b-ee344c59febb service nova] Enqueued Resource ID: 15cae89a-6005-4f02-95eb-d04ef2f8ea8e with Priority: HIGHEST for action security_group_members [ 699.904244] env[65471]: INFO networking_nsxv3.common.synchronization [req-51b48798-28ce-4ada-90ef-314d1689b72e req-7e218b63-0abb-4305-a69b-ee344c59febb service nova] Enqueued Resource ID: 7519415c-ba4c-4d51-bee9-ff34248bd954 with Priority: HIGHEST for action port [ 699.906045] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15cae89a-6005-4f02-95eb-d04ef2f8ea8e with Priority: HIGHEST for action security_group_rules [ 699.906045] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15cae89a-6005-4f02-95eb-d04ef2f8ea8e with Priority: HIGHEST for action security_group_members [ 699.906045] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7519415c-ba4c-4d51-bee9-ff34248bd954 with Priority: HIGHEST for action port [ 699.906233] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15cae89a-6005-4f02-95eb-d04ef2f8ea8e taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.906233] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.906443] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.906525] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.906738] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-7519415c-ba4c-4d51-bee9-ff34248bd954 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.906931] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7519415c-ba4c-4d51-bee9-ff34248bd954" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.906931] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7519415c-ba4c-4d51-bee9-ff34248bd954" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.908238] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7519415c-ba4c-4d51-bee9-ff34248bd954" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.908339] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7519415c-ba4c-4d51-bee9-ff34248bd954',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.155032] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15cae89a-6005-4f02-95eb-d04ef2f8ea8e in Status: SUCCESS [ 700.155303] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.155500] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.155729] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.155926] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.156070] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.156143] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.156287] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.156378] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.156476] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15cae89a-6005-4f02-95eb-d04ef2f8ea8e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.413827] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7519415c-ba4c-4d51-bee9-ff34248bd954 with status ACTIVE [ 700.414107] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.414388] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.414388] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.414578] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.414652] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.414808] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.414923] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.414987] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.415276] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.415276] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.415412] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.415683] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.415683] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.415943] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.415943] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.415943] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7519415c-ba4c-4d51-bee9-ff34248bd954 is going to be updated. [ 700.445264] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.445431] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.445478] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.447679] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.447679] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.447679] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7519415c-ba4c-4d51-bee9-ff34248bd954" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.450203] env[65471]: INFO networking_nsxv3.common.synchronization [req-016399be-166e-4914-bf05-b2a18ec4ac9e req-63ff9e3c-59dc-4fe4-a835-1cd309e04eca tempest-ServersAdminTestJSON-1197360877 tempest-ServersAdminTestJSON-1197360877-project-member] Enqueued Resource ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 with Priority: HIGHEST for action security_group_members [ 700.451790] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 with Priority: HIGHEST for action security_group_members [ 700.452313] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4ca8456-5b21-4080-b762-7b52a4837eb1 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.452313] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.452313] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.452596] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.452736] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.453199] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.453294] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.453482] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.453594] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.453748] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4ca8456-5b21-4080-b762-7b52a4837eb1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.659195] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15cae89a-6005-4f02-95eb-d04ef2f8ea8e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.748654] env[65471]: INFO networking_nsxv3.common.synchronization [None req-eddb7790-9778-4f51-9a79-f29f15f01c98 None None] Enqueued Resource ID: b37a58b3-25ec-41af-b648-5ef3232cbe5b with Priority: HIGHEST for action port [ 700.749350] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b37a58b3-25ec-41af-b648-5ef3232cbe5b with Priority: HIGHEST for action port [ 700.749686] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-b37a58b3-25ec-41af-b648-5ef3232cbe5b taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.749811] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b37a58b3-25ec-41af-b648-5ef3232cbe5b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.750209] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b37a58b3-25ec-41af-b648-5ef3232cbe5b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.750209] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b37a58b3-25ec-41af-b648-5ef3232cbe5b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.751017] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b37a58b3-25ec-41af-b648-5ef3232cbe5b',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.832495] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock network-593 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.832775] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "network-593" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.833119] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "network-593" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.833190] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "network-593" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.833397] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.833548] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.833654] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.833862] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.834608] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.835391] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 700.835391] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 700.835391] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 700.835734] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 700.835734] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 700.835734] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 700.835849] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 700.844423] env[65471]: INFO networking_nsxv3.common.synchronization [None req-ff3663e5-e22e-4b18-a2c1-abe8b83197eb None None] Enqueued Resource ID: 477cb64c-e441-4010-82f7-e5f8bbe3b832 with Priority: HIGHEST for action port [ 700.845767] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 477cb64c-e441-4010-82f7-e5f8bbe3b832 with Priority: HIGHEST for action port [ 700.846088] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-477cb64c-e441-4010-82f7-e5f8bbe3b832 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.846250] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-477cb64c-e441-4010-82f7-e5f8bbe3b832" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.846346] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-477cb64c-e441-4010-82f7-e5f8bbe3b832" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.846670] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-477cb64c-e441-4010-82f7-e5f8bbe3b832" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.846784] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('477cb64c-e441-4010-82f7-e5f8bbe3b832',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.855097] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 700.855320] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 700.855597] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 700.855797] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "network-593" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.856252] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock port-95004c5a-e02a-4ba9-909f-bf78f17ca8c2 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.857049] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "port-95004c5a-e02a-4ba9-909f-bf78f17ca8c2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.857049] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "port-95004c5a-e02a-4ba9-909f-bf78f17ca8c2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.857049] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "port-95004c5a-e02a-4ba9-909f-bf78f17ca8c2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.857218] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95004c5a-e02a-4ba9-909f-bf78f17ca8c2',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.928738] env[65471]: INFO networking_nsxv3.common.synchronization [None req-abdff349-d127-4951-a20c-cbc6f88093db None None] Enqueued Resource ID: 97f4f33c-7847-44d5-be6a-224d1bc87f29 with Priority: HIGHEST for action port [ 700.929357] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97f4f33c-7847-44d5-be6a-224d1bc87f29 with Priority: HIGHEST for action port [ 700.929670] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-97f4f33c-7847-44d5-be6a-224d1bc87f29 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.929788] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-97f4f33c-7847-44d5-be6a-224d1bc87f29" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.929960] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-97f4f33c-7847-44d5-be6a-224d1bc87f29" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.930241] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-97f4f33c-7847-44d5-be6a-224d1bc87f29" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.930460] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97f4f33c-7847-44d5-be6a-224d1bc87f29',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.956837] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e4ca8456-5b21-4080-b762-7b52a4837eb1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.162886] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15cae89a-6005-4f02-95eb-d04ef2f8ea8e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.253590] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b37a58b3-25ec-41af-b648-5ef3232cbe5b [ 701.253842] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.254015] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.254069] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.254278] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.254378] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.254463] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b37a58b3-25ec-41af-b648-5ef3232cbe5b already deleted. [ 701.254547] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b37a58b3-25ec-41af-b648-5ef3232cbe5b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.351077] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 477cb64c-e441-4010-82f7-e5f8bbe3b832 [ 701.351077] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.351077] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.351077] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.351077] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.351077] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.351077] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:477cb64c-e441-4010-82f7-e5f8bbe3b832 already deleted. [ 701.351077] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-477cb64c-e441-4010-82f7-e5f8bbe3b832" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.360733] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.360972] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.361107] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.361388] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.361526] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.361681] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Segment Port 95004c5a-e02a-4ba9-909f-bf78f17ca8c2 not found, creating... [ 701.361993] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.362176] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.362336] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.362542] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.362654] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.362945] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.363124] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.363230] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.363429] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.363549] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.363678] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Resource: SegmentPort with ID: 95004c5a-e02a-4ba9-909f-bf78f17ca8c2 is going to be created. [ 701.395542] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.395542] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.395542] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.395542] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.395542] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.396033] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "port-95004c5a-e02a-4ba9-909f-bf78f17ca8c2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.434093] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 97f4f33c-7847-44d5-be6a-224d1bc87f29 [ 701.434093] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.434448] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.434448] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.434539] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.434629] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.434723] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:97f4f33c-7847-44d5-be6a-224d1bc87f29 already deleted. [ 701.434817] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-97f4f33c-7847-44d5-be6a-224d1bc87f29" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.460023] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e4ca8456-5b21-4080-b762-7b52a4837eb1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.665915] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.666654] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.666775] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.666999] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.667104] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.667226] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15cae89a-6005-4f02-95eb-d04ef2f8ea8e is going to be updated. [ 701.706704] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.706905] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.707000] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.707524] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.707706] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.725293] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15cae89a-6005-4f02-95eb-d04ef2f8ea8e in Status: IN_PROGRESS for 2s [ 701.811291] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cefc497-117e-45da-bc1f-1ab0ea166d74 in Status: SUCCESS [ 701.811291] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.811291] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.811291] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.811291] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.811291] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.811291] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.811612] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.811612] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.811612] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.811706] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cefc497-117e-45da-bc1f-1ab0ea166d74 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.811759] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.814027] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.814027] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.814027] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.814027] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.814027] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.814027] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.814027] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.814027] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.814027] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7cefc497-117e-45da-bc1f-1ab0ea166d74',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.962746] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.963102] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.963102] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.963242] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.963419] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.963419] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 is going to be updated. [ 702.016961] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.017168] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.017253] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.017653] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.017888] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.030382] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 in Status: IN_PROGRESS for 2s [ 702.287403] env[65471]: INFO networking_nsxv3.common.synchronization [req-dc42a724-7e44-4736-9959-7c5ffaa1edd0 req-da1847c2-835b-45a3-b66a-aa6daf22d980 tempest-ServersTestManualDisk-1928283683 tempest-ServersTestManualDisk-1928283683-project-member] Enqueued Resource ID: cd8e3453-8620-4f9d-b764-155e97a20205 with Priority: HIGHEST for action security_group_members [ 702.290889] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd8e3453-8620-4f9d-b764-155e97a20205 with Priority: HIGHEST for action security_group_members [ 702.290889] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd8e3453-8620-4f9d-b764-155e97a20205 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.290889] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd8e3453-8620-4f9d-b764-155e97a20205" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.290889] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd8e3453-8620-4f9d-b764-155e97a20205" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.291325] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd8e3453-8620-4f9d-b764-155e97a20205" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.292751] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.292751] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.292751] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.292751] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.292751] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.292751] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd8e3453-8620-4f9d-b764-155e97a20205',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.319280] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7cefc497-117e-45da-bc1f-1ab0ea166d74: rpc.has_security_group_logging(os_id): False [ 702.339962] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.340217] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.340295] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.341573] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.366420] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.366745] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.366903] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.366981] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.367208] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.367293] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.367487] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.368575] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.368575] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.368575] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.368575] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.368575] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.368575] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.368575] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.368575] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.368575] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.368575] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7cefc497-117e-45da-bc1f-1ab0ea166d74 is going to be updated. [ 702.435291] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.435500] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.435500] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.435774] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.435943] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.456022] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7cefc497-117e-45da-bc1f-1ab0ea166d74 in Status: IN_PROGRESS for 2s [ 702.662879] env[65471]: INFO networking_nsxv3.common.synchronization [req-016399be-166e-4914-bf05-b2a18ec4ac9e req-edbb6421-6424-467d-a5fb-b3de32db9b98 service nova] Enqueued Resource ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 with Priority: HIGHEST for action security_group_rules [ 702.662879] env[65471]: INFO networking_nsxv3.common.synchronization [req-016399be-166e-4914-bf05-b2a18ec4ac9e req-edbb6421-6424-467d-a5fb-b3de32db9b98 service nova] Enqueued Resource ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 with Priority: HIGHEST for action security_group_members [ 702.662879] env[65471]: INFO networking_nsxv3.common.synchronization [req-016399be-166e-4914-bf05-b2a18ec4ac9e req-edbb6421-6424-467d-a5fb-b3de32db9b98 service nova] Enqueued Resource ID: 95004c5a-e02a-4ba9-909f-bf78f17ca8c2 with Priority: HIGHEST for action port [ 702.663540] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 with Priority: HIGHEST for action security_group_rules [ 702.663700] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 with Priority: HIGHEST for action security_group_members [ 702.663829] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95004c5a-e02a-4ba9-909f-bf78f17ca8c2 with Priority: HIGHEST for action port [ 702.665026] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e4ca8456-5b21-4080-b762-7b52a4837eb1 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.665026] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.665026] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.665026] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.665026] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e4ca8456-5b21-4080-b762-7b52a4837eb1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.666123] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4ca8456-5b21-4080-b762-7b52a4837eb1 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.666260] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.669602] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-95004c5a-e02a-4ba9-909f-bf78f17ca8c2 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.669602] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-95004c5a-e02a-4ba9-909f-bf78f17ca8c2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.669602] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-95004c5a-e02a-4ba9-909f-bf78f17ca8c2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.669602] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-95004c5a-e02a-4ba9-909f-bf78f17ca8c2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.669602] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95004c5a-e02a-4ba9-909f-bf78f17ca8c2',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.803941] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.803941] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.803941] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.803941] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.803941] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.803941] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.803941] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.803941] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.803941] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.803941] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.803941] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd8e3453-8620-4f9d-b764-155e97a20205 already deleted. [ 702.804673] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd8e3453-8620-4f9d-b764-155e97a20205" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.806494] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock network-786 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.808849] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "network-786" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.809032] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "network-786" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.809392] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "network-786" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.809782] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.809906] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.810455] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.810856] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.811198] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.812040] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 702.812040] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 702.812040] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 702.812306] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 702.812306] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 702.812306] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 702.812419] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 702.842325] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 702.842562] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 702.842706] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 702.842884] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "network-786" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.843221] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock port-4b8a5f23-a5c9-4f28-96aa-007d05ede83c taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.844057] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "port-4b8a5f23-a5c9-4f28-96aa-007d05ede83c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.844057] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "port-4b8a5f23-a5c9-4f28-96aa-007d05ede83c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.844057] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "port-4b8a5f23-a5c9-4f28-96aa-007d05ede83c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.844309] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b8a5f23-a5c9-4f28-96aa-007d05ede83c',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.168824] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4ca8456-5b21-4080-b762-7b52a4837eb1 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.168824] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.173432] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 95004c5a-e02a-4ba9-909f-bf78f17ca8c2 with status ACTIVE [ 703.173650] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.173793] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.173862] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.174107] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.174201] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.174401] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.174503] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.174548] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.174697] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.174772] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.174957] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.175064] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.175124] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.175266] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.175338] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.175424] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 95004c5a-e02a-4ba9-909f-bf78f17ca8c2 is going to be updated. [ 703.204871] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.205064] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.205160] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.205386] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.205540] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.205723] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-95004c5a-e02a-4ba9-909f-bf78f17ca8c2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.350144] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.350657] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.351298] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.351790] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.352462] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.352810] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Segment Port 4b8a5f23-a5c9-4f28-96aa-007d05ede83c not found, creating... [ 703.353311] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.353796] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.357817] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.357817] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.357817] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.357817] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.357817] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.357817] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.357817] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.357817] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.357817] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Resource: SegmentPort with ID: 4b8a5f23-a5c9-4f28-96aa-007d05ede83c is going to be created. [ 703.379822] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.380133] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.380279] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.380541] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.381479] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.381479] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "port-4b8a5f23-a5c9-4f28-96aa-007d05ede83c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.738527] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15cae89a-6005-4f02-95eb-d04ef2f8ea8e in Status: SUCCESS [ 703.738830] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.739078] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.740585] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.740874] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.741034] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.741129] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.741321] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.741416] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.741515] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.741728] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.741861] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.742091] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.747390] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.747621] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.747751] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.747830] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.748115] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.748240] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.748359] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.748526] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('15cae89a-6005-4f02-95eb-d04ef2f8ea8e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.749554] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.749827] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.750214] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.750383] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.750456] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.751150] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.751150] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.751150] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15cae89a-6005-4f02-95eb-d04ef2f8ea8e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.042151] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 in Status: SUCCESS [ 704.042465] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.042674] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.042937] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.043157] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.043311] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.043425] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.043649] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.043741] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.043917] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4ca8456-5b21-4080-b762-7b52a4837eb1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.145347] env[65471]: INFO networking_nsxv3.common.synchronization [req-dc42a724-7e44-4736-9959-7c5ffaa1edd0 req-4ab8f515-1d0d-4f8d-ba1c-fea046d83a3b service nova] Enqueued Resource ID: cd8e3453-8620-4f9d-b764-155e97a20205 with Priority: HIGHEST for action security_group_rules [ 704.145347] env[65471]: INFO networking_nsxv3.common.synchronization [req-dc42a724-7e44-4736-9959-7c5ffaa1edd0 req-4ab8f515-1d0d-4f8d-ba1c-fea046d83a3b service nova] Enqueued Resource ID: cd8e3453-8620-4f9d-b764-155e97a20205 with Priority: HIGHEST for action security_group_members [ 704.145347] env[65471]: INFO networking_nsxv3.common.synchronization [req-dc42a724-7e44-4736-9959-7c5ffaa1edd0 req-4ab8f515-1d0d-4f8d-ba1c-fea046d83a3b service nova] Enqueued Resource ID: 4b8a5f23-a5c9-4f28-96aa-007d05ede83c with Priority: HIGHEST for action port [ 704.145881] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd8e3453-8620-4f9d-b764-155e97a20205 with Priority: HIGHEST for action security_group_rules [ 704.146019] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd8e3453-8620-4f9d-b764-155e97a20205 with Priority: HIGHEST for action security_group_members [ 704.150049] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b8a5f23-a5c9-4f28-96aa-007d05ede83c with Priority: HIGHEST for action port [ 704.150049] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd8e3453-8620-4f9d-b764-155e97a20205 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.150324] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd8e3453-8620-4f9d-b764-155e97a20205" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.150324] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd8e3453-8620-4f9d-b764-155e97a20205" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.150396] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd8e3453-8620-4f9d-b764-155e97a20205" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.150450] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd8e3453-8620-4f9d-b764-155e97a20205',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.151660] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd8e3453-8620-4f9d-b764-155e97a20205 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.151810] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd8e3453-8620-4f9d-b764-155e97a20205" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.151810] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd8e3453-8620-4f9d-b764-155e97a20205" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.152089] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd8e3453-8620-4f9d-b764-155e97a20205" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.152174] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.152301] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.152363] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.152544] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.152610] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.152707] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd8e3453-8620-4f9d-b764-155e97a20205',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.156748] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-4b8a5f23-a5c9-4f28-96aa-007d05ede83c taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.156900] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4b8a5f23-a5c9-4f28-96aa-007d05ede83c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.156984] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4b8a5f23-a5c9-4f28-96aa-007d05ede83c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.157217] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4b8a5f23-a5c9-4f28-96aa-007d05ede83c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.157303] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b8a5f23-a5c9-4f28-96aa-007d05ede83c',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.256960] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 15cae89a-6005-4f02-95eb-d04ef2f8ea8e: rpc.has_security_group_logging(os_id): False [ 704.256960] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15cae89a-6005-4f02-95eb-d04ef2f8ea8e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.278323] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.278563] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.279101] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.279101] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.279173] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.280065] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.280065] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.280065] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.280065] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.280065] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.280609] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.280726] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.280925] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.281650] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.281756] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.282009] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.282138] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.282214] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.282450] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.282521] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.282727] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15cae89a-6005-4f02-95eb-d04ef2f8ea8e is going to be created. [ 704.358957] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.359271] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.359330] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.359902] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.360676] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.375603] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15cae89a-6005-4f02-95eb-d04ef2f8ea8e in Status: IN_PROGRESS for 2s [ 704.483145] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7cefc497-117e-45da-bc1f-1ab0ea166d74 in Status: SUCCESS [ 704.483385] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.483569] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.483903] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.483903] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7cefc497-117e-45da-bc1f-1ab0ea166d74',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.547509] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e4ca8456-5b21-4080-b762-7b52a4837eb1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.660040] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd8e3453-8620-4f9d-b764-155e97a20205 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.660040] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd8e3453-8620-4f9d-b764-155e97a20205" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.660040] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cd8e3453-8620-4f9d-b764-155e97a20205',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.662595] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4b8a5f23-a5c9-4f28-96aa-007d05ede83c with status ACTIVE [ 704.662791] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.663014] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.663130] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.663782] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.663782] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.663782] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.663782] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.663961] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.664727] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.664873] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.665083] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.665185] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.665251] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.665951] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.665951] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.665951] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4b8a5f23-a5c9-4f28-96aa-007d05ede83c is going to be updated. [ 704.693580] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.693725] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.693812] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.694056] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.694196] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.694360] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4b8a5f23-a5c9-4f28-96aa-007d05ede83c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.763064] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15cae89a-6005-4f02-95eb-d04ef2f8ea8e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.989052] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cefc497-117e-45da-bc1f-1ab0ea166d74 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.989489] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.989489] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.989568] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.991325] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.991325] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.991325] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.991325] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.991325] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.991325] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.991325] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7cefc497-117e-45da-bc1f-1ab0ea166d74',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.050783] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e4ca8456-5b21-4080-b762-7b52a4837eb1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.088413] env[65471]: INFO networking_nsxv3.common.synchronization [None req-dfe1c40c-d8e1-4352-9c20-e9f043a45b3d None None] Enqueued Resource ID: 12163f18-bd60-4459-9b8b-bc1a46716982 with Priority: HIGHEST for action port [ 705.089509] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12163f18-bd60-4459-9b8b-bc1a46716982 with Priority: HIGHEST for action port [ 705.089835] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-12163f18-bd60-4459-9b8b-bc1a46716982 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.090736] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12163f18-bd60-4459-9b8b-bc1a46716982" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.090896] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12163f18-bd60-4459-9b8b-bc1a46716982" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.092032] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12163f18-bd60-4459-9b8b-bc1a46716982" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.092032] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12163f18-bd60-4459-9b8b-bc1a46716982',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.163073] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cd8e3453-8620-4f9d-b764-155e97a20205',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.265485] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.265485] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.265485] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.265853] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.265853] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.265853] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15cae89a-6005-4f02-95eb-d04ef2f8ea8e is going to be updated. [ 705.323894] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.324076] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.324133] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.324377] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.324980] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.355776] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15cae89a-6005-4f02-95eb-d04ef2f8ea8e in Status: IN_PROGRESS for 2s [ 705.496039] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cefc497-117e-45da-bc1f-1ab0ea166d74 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.496039] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.496039] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.496039] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.496039] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.496039] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.496039] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.496039] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.496039] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.496039] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.496039] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cefc497-117e-45da-bc1f-1ab0ea166d74 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.496039] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.496039] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.496039] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.496039] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.496039] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.496865] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.496865] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.496865] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.496865] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.496865] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7cefc497-117e-45da-bc1f-1ab0ea166d74',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.554235] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.554393] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.554465] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.554850] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.554961] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.555066] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 is going to be updated. [ 705.591275] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.591275] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.591275] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.591275] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.591275] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.599247] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 12163f18-bd60-4459-9b8b-bc1a46716982 [ 705.599247] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.599247] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.599247] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.599247] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.599247] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.599247] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:12163f18-bd60-4459-9b8b-bc1a46716982 already deleted. [ 705.599247] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12163f18-bd60-4459-9b8b-bc1a46716982" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.604807] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 in Status: IN_PROGRESS for 2s [ 705.665952] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.667349] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.667493] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.667672] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.667819] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.667881] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd8e3453-8620-4f9d-b764-155e97a20205 is going to be created. [ 705.698151] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.698351] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.698393] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.698902] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.698978] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.711704] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd8e3453-8620-4f9d-b764-155e97a20205 in Status: UNINITIALIZED for 2s [ 706.006546] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7cefc497-117e-45da-bc1f-1ab0ea166d74: rpc.has_security_group_logging(os_id): False [ 706.030164] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.030452] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.030452] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.030671] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.030792] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.031086] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.031226] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.031226] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.031373] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.031452] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.031666] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.031767] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.031887] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.032194] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.032301] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.032655] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.032835] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.032908] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.033219] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.033284] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.033479] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7cefc497-117e-45da-bc1f-1ab0ea166d74 is going to be updated. [ 706.123246] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.123246] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.123246] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.123463] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.123899] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.146663] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7cefc497-117e-45da-bc1f-1ab0ea166d74 in Status: IN_PROGRESS for 2s [ 706.387432] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15cae89a-6005-4f02-95eb-d04ef2f8ea8e in Status: SUCCESS [ 706.387769] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.387905] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.388162] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.388252] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15cae89a-6005-4f02-95eb-d04ef2f8ea8e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.892781] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.892781] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.039140] env[65471]: INFO networking_nsxv3.common.synchronization [req-652f2f0e-9fb9-49a0-b24e-331d23168eb2 req-009768ed-9da6-47bf-9760-df7cfb112b50 tempest-InstanceActionsNegativeTestJSON-1472382695 tempest-InstanceActionsNegativeTestJSON-1472382695-project-member] Enqueued Resource ID: 69a8cc18-3d2c-4522-9688-4b5525d659e0 with Priority: HIGHEST for action security_group_members [ 707.039140] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69a8cc18-3d2c-4522-9688-4b5525d659e0 with Priority: HIGHEST for action security_group_members [ 707.039140] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-69a8cc18-3d2c-4522-9688-4b5525d659e0 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.039443] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69a8cc18-3d2c-4522-9688-4b5525d659e0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.039443] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69a8cc18-3d2c-4522-9688-4b5525d659e0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.041708] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69a8cc18-3d2c-4522-9688-4b5525d659e0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.041892] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.043489] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.043489] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.043489] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.043489] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.043489] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69a8cc18-3d2c-4522-9688-4b5525d659e0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.369413] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15cae89a-6005-4f02-95eb-d04ef2f8ea8e in Status: SUCCESS [ 707.369413] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.369413] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.369413] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.369413] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.369413] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.369413] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.369413] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.369413] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.369413] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15cae89a-6005-4f02-95eb-d04ef2f8ea8e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.532025] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock network-672 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.532281] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "network-672" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.532391] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "network-672" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.532714] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "network-672" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.532969] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.533169] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.533280] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.533649] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.533722] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.533892] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 707.533980] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 707.534106] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 707.534207] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 707.534309] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 707.534410] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 707.534518] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 707.545481] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.546389] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.546389] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.546389] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.546389] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.546389] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.546612] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.546612] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.546676] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.546756] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.546837] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69a8cc18-3d2c-4522-9688-4b5525d659e0 already deleted. [ 707.546913] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69a8cc18-3d2c-4522-9688-4b5525d659e0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.555032] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 707.555515] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 707.555515] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 707.555678] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "network-672" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.555921] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock port-cac2f4dc-6e15-4430-bf81-f6cca0ccc092 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.556093] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "port-cac2f4dc-6e15-4430-bf81-f6cca0ccc092" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.556213] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "port-cac2f4dc-6e15-4430-bf81-f6cca0ccc092" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.556531] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "port-cac2f4dc-6e15-4430-bf81-f6cca0ccc092" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.556635] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cac2f4dc-6e15-4430-bf81-f6cca0ccc092',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.618448] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 in Status: SUCCESS [ 707.618679] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.619234] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.619444] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.619633] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.619745] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.619852] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.620422] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.620422] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.620422] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.620422] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e4ca8456-5b21-4080-b762-7b52a4837eb1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.726583] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd8e3453-8620-4f9d-b764-155e97a20205 in Status: SUCCESS [ 707.726803] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd8e3453-8620-4f9d-b764-155e97a20205" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.726978] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd8e3453-8620-4f9d-b764-155e97a20205" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.731393] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd8e3453-8620-4f9d-b764-155e97a20205" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.731393] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.731393] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.731393] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.731393] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.731393] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.731393] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd8e3453-8620-4f9d-b764-155e97a20205" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.731393] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cd8e3453-8620-4f9d-b764-155e97a20205',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.874846] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15cae89a-6005-4f02-95eb-d04ef2f8ea8e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.058809] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.059977] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.059977] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.059977] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.060185] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.060349] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Segment Port cac2f4dc-6e15-4430-bf81-f6cca0ccc092 not found, creating... [ 708.061135] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.061135] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.061135] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.061391] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.061528] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.061821] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.062441] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.062441] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.062441] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.062441] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.062897] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Resource: SegmentPort with ID: cac2f4dc-6e15-4430-bf81-f6cca0ccc092 is going to be created. [ 708.085176] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.085427] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.085515] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.086128] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.086415] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.086811] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "port-cac2f4dc-6e15-4430-bf81-f6cca0ccc092" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.123707] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4ca8456-5b21-4080-b762-7b52a4837eb1 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.123958] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.124092] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.124446] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.124691] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.124849] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.125057] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.125394] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.125642] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.125816] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.126103] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4ca8456-5b21-4080-b762-7b52a4837eb1 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.126252] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.126396] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.126999] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.126999] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.127189] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.127189] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.127400] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.127549] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.127693] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.127849] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e4ca8456-5b21-4080-b762-7b52a4837eb1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.165696] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7cefc497-117e-45da-bc1f-1ab0ea166d74 in Status: SUCCESS [ 708.165944] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.235617] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cd8e3453-8620-4f9d-b764-155e97a20205',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.379468] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15cae89a-6005-4f02-95eb-d04ef2f8ea8e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.630359] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e4ca8456-5b21-4080-b762-7b52a4837eb1: rpc.has_security_group_logging(os_id): False [ 708.654602] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.654870] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.654870] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.655026] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.676309] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.676710] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.676892] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.676997] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.677287] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.677427] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.677736] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.678227] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.678227] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.678432] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.678432] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.678568] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.678676] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.678737] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.678908] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.678977] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.679075] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 is going to be updated. [ 708.737339] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cd8e3453-8620-4f9d-b764-155e97a20205: rpc.has_security_group_logging(os_id): False [ 708.746379] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.746668] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.750124] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.750124] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.750124] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.760021] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.760245] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.760245] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.762190] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.762190] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.762190] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.762190] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.762190] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.762190] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.762190] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.762190] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd8e3453-8620-4f9d-b764-155e97a20205 is going to be created. [ 708.771109] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 in Status: IN_PROGRESS for 2s [ 708.868110] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.868282] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.868381] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.868633] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.868937] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.881713] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.881898] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.881937] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.882271] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.882375] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.882520] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15cae89a-6005-4f02-95eb-d04ef2f8ea8e is going to be updated. [ 708.887638] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd8e3453-8620-4f9d-b764-155e97a20205 in Status: IN_PROGRESS for 2s [ 708.927663] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.927851] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.927905] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.928389] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.928539] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.943131] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15cae89a-6005-4f02-95eb-d04ef2f8ea8e in Status: IN_PROGRESS for 2s [ 709.197890] env[65471]: INFO networking_nsxv3.common.synchronization [req-652f2f0e-9fb9-49a0-b24e-331d23168eb2 req-fce8abed-8b5e-48d9-8704-b9809f2cd262 service nova] Enqueued Resource ID: 69a8cc18-3d2c-4522-9688-4b5525d659e0 with Priority: HIGHEST for action security_group_rules [ 709.198115] env[65471]: INFO networking_nsxv3.common.synchronization [req-652f2f0e-9fb9-49a0-b24e-331d23168eb2 req-fce8abed-8b5e-48d9-8704-b9809f2cd262 service nova] Enqueued Resource ID: 69a8cc18-3d2c-4522-9688-4b5525d659e0 with Priority: HIGHEST for action security_group_members [ 709.198267] env[65471]: INFO networking_nsxv3.common.synchronization [req-652f2f0e-9fb9-49a0-b24e-331d23168eb2 req-fce8abed-8b5e-48d9-8704-b9809f2cd262 service nova] Enqueued Resource ID: cac2f4dc-6e15-4430-bf81-f6cca0ccc092 with Priority: HIGHEST for action port [ 709.198773] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69a8cc18-3d2c-4522-9688-4b5525d659e0 with Priority: HIGHEST for action security_group_rules [ 709.199067] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69a8cc18-3d2c-4522-9688-4b5525d659e0 with Priority: HIGHEST for action security_group_members [ 709.199067] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cac2f4dc-6e15-4430-bf81-f6cca0ccc092 with Priority: HIGHEST for action port [ 709.199276] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69a8cc18-3d2c-4522-9688-4b5525d659e0 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.199395] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69a8cc18-3d2c-4522-9688-4b5525d659e0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.199463] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69a8cc18-3d2c-4522-9688-4b5525d659e0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.199717] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69a8cc18-3d2c-4522-9688-4b5525d659e0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.199801] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69a8cc18-3d2c-4522-9688-4b5525d659e0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.203552] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-69a8cc18-3d2c-4522-9688-4b5525d659e0 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.203552] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69a8cc18-3d2c-4522-9688-4b5525d659e0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.203552] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69a8cc18-3d2c-4522-9688-4b5525d659e0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.203552] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69a8cc18-3d2c-4522-9688-4b5525d659e0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.203552] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.203552] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.203552] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.203552] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.203552] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.203552] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69a8cc18-3d2c-4522-9688-4b5525d659e0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.203552] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-cac2f4dc-6e15-4430-bf81-f6cca0ccc092 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.203552] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cac2f4dc-6e15-4430-bf81-f6cca0ccc092" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.203552] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cac2f4dc-6e15-4430-bf81-f6cca0ccc092" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.203552] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cac2f4dc-6e15-4430-bf81-f6cca0ccc092" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.203552] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cac2f4dc-6e15-4430-bf81-f6cca0ccc092',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.580443] env[65471]: INFO networking_nsxv3.common.synchronization [req-89ee613e-75bc-4feb-a06e-def661e4a38c req-ee873778-1fb4-4927-be56-d2c13944ed99 tempest-ServerActionsTestOtherA-1623203122 tempest-ServerActionsTestOtherA-1623203122-project-member] Enqueued Resource ID: f7dafcbc-15be-4704-ad92-28657ead70aa with Priority: HIGHEST for action security_group_members [ 709.581524] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7dafcbc-15be-4704-ad92-28657ead70aa with Priority: HIGHEST for action security_group_members [ 709.581886] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7dafcbc-15be-4704-ad92-28657ead70aa taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.582077] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.582124] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.582380] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.582562] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.582693] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.582771] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.582926] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.583032] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.583131] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7dafcbc-15be-4704-ad92-28657ead70aa',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.705805] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('69a8cc18-3d2c-4522-9688-4b5525d659e0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.709080] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-69a8cc18-3d2c-4522-9688-4b5525d659e0 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.709080] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69a8cc18-3d2c-4522-9688-4b5525d659e0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.709080] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cac2f4dc-6e15-4430-bf81-f6cca0ccc092 with status ACTIVE [ 709.709080] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.709080] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.709080] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.709080] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.709080] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.709080] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.710059] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.710059] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.710059] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.710059] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.710408] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.710408] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.710408] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.710513] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.711211] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.711828] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cac2f4dc-6e15-4430-bf81-f6cca0ccc092 is going to be updated. [ 709.742062] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.743082] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.743082] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.743082] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.743082] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.743082] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cac2f4dc-6e15-4430-bf81-f6cca0ccc092" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.086179] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.086179] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.086179] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.086179] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.086179] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.086179] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.086179] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.086179] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.086498] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.086498] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.086498] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7dafcbc-15be-4704-ad92-28657ead70aa already deleted. [ 710.086568] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.184718] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock network-344 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.184718] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "network-344" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.184718] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "network-344" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.184718] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "network-344" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.184718] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.184718] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.185224] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.185510] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.185678] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.185899] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 710.186033] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 710.186142] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 710.186248] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 710.186360] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 710.186461] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 710.186594] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 710.208170] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 710.208338] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 710.208462] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 710.208629] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "network-344" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.209030] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock port-12b3e634-109e-41da-b9b2-c96ea170fad8 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.209669] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "port-12b3e634-109e-41da-b9b2-c96ea170fad8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.209669] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "port-12b3e634-109e-41da-b9b2-c96ea170fad8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.209669] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "port-12b3e634-109e-41da-b9b2-c96ea170fad8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.209829] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12b3e634-109e-41da-b9b2-c96ea170fad8',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.210774] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('69a8cc18-3d2c-4522-9688-4b5525d659e0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.714974] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.715327] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.715327] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.715560] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.715650] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.715751] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69a8cc18-3d2c-4522-9688-4b5525d659e0 is going to be created. [ 710.717251] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.717423] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.717537] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.717767] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.717929] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.718112] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Segment Port 12b3e634-109e-41da-b9b2-c96ea170fad8 not found, creating... [ 710.718361] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.718506] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.718636] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.718905] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.718990] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.719245] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.719391] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.719499] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.719693] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.719818] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.719994] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Resource: SegmentPort with ID: 12b3e634-109e-41da-b9b2-c96ea170fad8 is going to be created. [ 710.744652] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.744846] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.744958] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.745242] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.745466] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.745679] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "port-12b3e634-109e-41da-b9b2-c96ea170fad8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.750273] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.750273] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.750485] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.750628] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.750762] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.761171] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69a8cc18-3d2c-4522-9688-4b5525d659e0 in Status: UNINITIALIZED for 2s [ 710.788396] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 in Status: SUCCESS [ 710.788396] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.900465] env[65471]: INFO networking_nsxv3.common.synchronization [None req-09cb4c11-c449-47a6-a923-0dd4d4c0faad None None] Enqueued Resource ID: e4ec3098-de5b-4274-acb7-a46474f9c014 with Priority: HIGHEST for action port [ 710.901419] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4ec3098-de5b-4274-acb7-a46474f9c014 with Priority: HIGHEST for action port [ 710.902395] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-e4ec3098-de5b-4274-acb7-a46474f9c014 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.902671] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e4ec3098-de5b-4274-acb7-a46474f9c014" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.902671] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e4ec3098-de5b-4274-acb7-a46474f9c014" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.902887] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e4ec3098-de5b-4274-acb7-a46474f9c014" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.902973] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4ec3098-de5b-4274-acb7-a46474f9c014',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.910657] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd8e3453-8620-4f9d-b764-155e97a20205 in Status: SUCCESS [ 710.911232] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd8e3453-8620-4f9d-b764-155e97a20205" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.955264] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15cae89a-6005-4f02-95eb-d04ef2f8ea8e in Status: SUCCESS [ 710.955264] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.955264] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.955264] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.955264] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.955264] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.955264] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.955264] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.955264] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.955264] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.955264] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('15cae89a-6005-4f02-95eb-d04ef2f8ea8e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.407946] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e4ec3098-de5b-4274-acb7-a46474f9c014 [ 711.410242] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.410242] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.410242] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.410242] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.410242] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.410242] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e4ec3098-de5b-4274-acb7-a46474f9c014 already deleted. [ 711.410242] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e4ec3098-de5b-4274-acb7-a46474f9c014" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.457240] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.457397] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.457458] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.457676] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.459446] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.459535] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.459586] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.459773] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.459859] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.459958] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.463761] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.463913] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.463965] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.464229] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.464290] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.464366] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.464429] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.464563] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.464638] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.464730] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.464800] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('15cae89a-6005-4f02-95eb-d04ef2f8ea8e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.525106] env[65471]: INFO networking_nsxv3.common.synchronization [req-89ee613e-75bc-4feb-a06e-def661e4a38c req-3b67e3d7-1816-4b5e-b301-7406b26ef108 service nova] Enqueued Resource ID: f7dafcbc-15be-4704-ad92-28657ead70aa with Priority: HIGHEST for action security_group_rules [ 711.525106] env[65471]: INFO networking_nsxv3.common.synchronization [req-89ee613e-75bc-4feb-a06e-def661e4a38c req-3b67e3d7-1816-4b5e-b301-7406b26ef108 service nova] Enqueued Resource ID: f7dafcbc-15be-4704-ad92-28657ead70aa with Priority: HIGHEST for action security_group_members [ 711.525268] env[65471]: INFO networking_nsxv3.common.synchronization [req-89ee613e-75bc-4feb-a06e-def661e4a38c req-3b67e3d7-1816-4b5e-b301-7406b26ef108 service nova] Enqueued Resource ID: 12b3e634-109e-41da-b9b2-c96ea170fad8 with Priority: HIGHEST for action port [ 711.526047] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7dafcbc-15be-4704-ad92-28657ead70aa with Priority: HIGHEST for action security_group_rules [ 711.529053] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7dafcbc-15be-4704-ad92-28657ead70aa with Priority: HIGHEST for action security_group_members [ 711.529053] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12b3e634-109e-41da-b9b2-c96ea170fad8 with Priority: HIGHEST for action port [ 711.529053] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7dafcbc-15be-4704-ad92-28657ead70aa taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.529276] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.529276] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.529742] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.529742] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7dafcbc-15be-4704-ad92-28657ead70aa',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.531323] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7dafcbc-15be-4704-ad92-28657ead70aa taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.531460] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.531525] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.531721] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.531869] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.531973] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.532085] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.532237] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.532345] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.532457] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7dafcbc-15be-4704-ad92-28657ead70aa',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.533278] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-12b3e634-109e-41da-b9b2-c96ea170fad8 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.533382] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12b3e634-109e-41da-b9b2-c96ea170fad8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.533658] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12b3e634-109e-41da-b9b2-c96ea170fad8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.533658] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12b3e634-109e-41da-b9b2-c96ea170fad8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.533658] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12b3e634-109e-41da-b9b2-c96ea170fad8',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.590609] env[65471]: INFO networking_nsxv3.common.synchronization [req-6a880a6b-8428-4680-895d-9b4360537e09 req-8019945c-1a2a-4b92-b576-f1cbe9a6a8e7 tempest-InstanceActionsTestJSON-1692996391 tempest-InstanceActionsTestJSON-1692996391-project-member] Enqueued Resource ID: 44e07836-d56c-494a-9b74-978c8fd6933f with Priority: HIGHEST for action security_group_members [ 711.591329] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44e07836-d56c-494a-9b74-978c8fd6933f with Priority: HIGHEST for action security_group_members [ 711.591655] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-44e07836-d56c-494a-9b74-978c8fd6933f taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.591785] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44e07836-d56c-494a-9b74-978c8fd6933f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.591864] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44e07836-d56c-494a-9b74-978c8fd6933f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.592252] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44e07836-d56c-494a-9b74-978c8fd6933f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.592452] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.592594] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.592663] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.592854] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.592950] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.593092] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44e07836-d56c-494a-9b74-978c8fd6933f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.968395] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 15cae89a-6005-4f02-95eb-d04ef2f8ea8e: rpc.has_security_group_logging(os_id): False [ 712.004601] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.004798] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.004798] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.005026] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.005192] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.005324] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.006281] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.006281] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.006281] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.006281] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.006281] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.006281] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.006281] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.006281] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.006281] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.006664] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.006664] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.006664] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.006764] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.006858] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.006893] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15cae89a-6005-4f02-95eb-d04ef2f8ea8e is going to be updated. [ 712.035111] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f7dafcbc-15be-4704-ad92-28657ead70aa',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.037144] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7dafcbc-15be-4704-ad92-28657ead70aa taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.037144] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.037144] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 12b3e634-109e-41da-b9b2-c96ea170fad8 with status ACTIVE [ 712.037144] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.037144] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.037144] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.037144] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.037443] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.037443] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.037515] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.037696] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.037742] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.038063] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.038415] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.038734] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.038861] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.040305] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.040616] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.040811] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 12b3e634-109e-41da-b9b2-c96ea170fad8 is going to be updated. [ 712.083245] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.083427] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.083493] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.083980] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.084244] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.084419] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12b3e634-109e-41da-b9b2-c96ea170fad8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.095670] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.095904] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.097634] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.097634] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.126454] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.126844] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.127040] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.127112] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.127319] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.127426] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.127527] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44e07836-d56c-494a-9b74-978c8fd6933f is going to be updated. [ 712.131196] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.131367] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.131425] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.131658] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.132631] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.150645] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15cae89a-6005-4f02-95eb-d04ef2f8ea8e in Status: IN_PROGRESS for 2s [ 712.191271] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.191271] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.191271] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.191271] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.191271] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.202227] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44e07836-d56c-494a-9b74-978c8fd6933f in Status: IN_PROGRESS for 2s [ 712.547653] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f7dafcbc-15be-4704-ad92-28657ead70aa',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.650833] env[65471]: INFO networking_nsxv3.common.synchronization [req-fa3becfd-4c5c-4c32-aead-817d3cb095f2 req-c1d1f2bd-e6eb-4814-af9b-0376ca948175 tempest-ImagesOneServerNegativeTestJSON-124059679 tempest-ImagesOneServerNegativeTestJSON-124059679-project-member] Enqueued Resource ID: a3c5f688-9271-4722-84e9-69667c674933 with Priority: HIGHEST for action security_group_members [ 712.651547] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3c5f688-9271-4722-84e9-69667c674933 with Priority: HIGHEST for action security_group_members [ 712.651963] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3c5f688-9271-4722-84e9-69667c674933 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.652623] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.652698] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.652961] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.653145] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.655811] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.655811] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.655811] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.655811] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.655811] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a3c5f688-9271-4722-84e9-69667c674933',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.775550] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69a8cc18-3d2c-4522-9688-4b5525d659e0 in Status: SUCCESS [ 712.775550] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69a8cc18-3d2c-4522-9688-4b5525d659e0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.775550] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69a8cc18-3d2c-4522-9688-4b5525d659e0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.775550] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69a8cc18-3d2c-4522-9688-4b5525d659e0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.775550] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.775550] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.775550] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.775550] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.775550] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.775550] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69a8cc18-3d2c-4522-9688-4b5525d659e0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.775550] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('69a8cc18-3d2c-4522-9688-4b5525d659e0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.056011] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.056011] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.056011] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.056011] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.056011] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.056011] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7dafcbc-15be-4704-ad92-28657ead70aa is going to be created. [ 713.088680] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.088822] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.088898] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.090517] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.090517] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.100410] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7dafcbc-15be-4704-ad92-28657ead70aa in Status: UNINITIALIZED for 2s [ 713.158553] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.158731] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.158819] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.159309] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.159472] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.159704] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.160155] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.160225] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.161328] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.161328] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.161328] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3c5f688-9271-4722-84e9-69667c674933 already deleted. [ 713.161328] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.279204] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-69a8cc18-3d2c-4522-9688-4b5525d659e0 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.279382] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69a8cc18-3d2c-4522-9688-4b5525d659e0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.279432] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69a8cc18-3d2c-4522-9688-4b5525d659e0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.279712] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69a8cc18-3d2c-4522-9688-4b5525d659e0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.279772] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.279887] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.280041] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.280222] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.280312] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.280402] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69a8cc18-3d2c-4522-9688-4b5525d659e0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.280567] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-69a8cc18-3d2c-4522-9688-4b5525d659e0 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.280668] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69a8cc18-3d2c-4522-9688-4b5525d659e0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.280761] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69a8cc18-3d2c-4522-9688-4b5525d659e0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.281514] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69a8cc18-3d2c-4522-9688-4b5525d659e0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.281514] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.281514] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.281514] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.281514] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.281514] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.281514] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69a8cc18-3d2c-4522-9688-4b5525d659e0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.281514] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('69a8cc18-3d2c-4522-9688-4b5525d659e0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.453913] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock network-16 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.454351] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "network-16" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.455687] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "network-16" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.456159] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "network-16" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.456510] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.456694] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.456887] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.457249] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.458056] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.458056] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 713.458056] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 713.458056] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 713.458056] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 713.458261] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 713.458261] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 713.458382] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 713.484691] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 713.484838] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 713.485026] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 713.485212] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "network-16" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.485578] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock port-4386c92e-7201-44b5-9eb5-c6e522ceb69d taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.485770] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "port-4386c92e-7201-44b5-9eb5-c6e522ceb69d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.485889] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "port-4386c92e-7201-44b5-9eb5-c6e522ceb69d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.486554] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "port-4386c92e-7201-44b5-9eb5-c6e522ceb69d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.487661] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4386c92e-7201-44b5-9eb5-c6e522ceb69d',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.786188] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 69a8cc18-3d2c-4522-9688-4b5525d659e0: rpc.has_security_group_logging(os_id): False [ 713.807768] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.807768] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.807768] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.807768] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.807768] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.807768] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.807768] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.807768] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.807768] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.807768] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.807768] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.808569] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.808639] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.811318] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.811439] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.812026] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.812026] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.812026] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.812026] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.812239] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.812239] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69a8cc18-3d2c-4522-9688-4b5525d659e0 is going to be created. [ 713.876056] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.876293] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.876370] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.876735] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.877013] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.890027] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69a8cc18-3d2c-4522-9688-4b5525d659e0 in Status: IN_PROGRESS for 2s [ 713.992619] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.992851] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.993043] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.994658] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.994658] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.994658] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Segment Port 4386c92e-7201-44b5-9eb5-c6e522ceb69d not found, creating... [ 713.994658] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.994658] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.994658] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.994929] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.995206] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.995788] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.995788] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.995788] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.996062] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.996150] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.996298] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Resource: SegmentPort with ID: 4386c92e-7201-44b5-9eb5-c6e522ceb69d is going to be created. [ 714.023338] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.023585] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.023656] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.023919] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.024158] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.024378] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "port-4386c92e-7201-44b5-9eb5-c6e522ceb69d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.167595] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15cae89a-6005-4f02-95eb-d04ef2f8ea8e in Status: SUCCESS [ 714.170050] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.170050] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.170050] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.170050] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15cae89a-6005-4f02-95eb-d04ef2f8ea8e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.226441] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44e07836-d56c-494a-9b74-978c8fd6933f in Status: SUCCESS [ 714.226441] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44e07836-d56c-494a-9b74-978c8fd6933f deletion is rescheduled due to dependency. [ 714.226441] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44e07836-d56c-494a-9b74-978c8fd6933f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.529517] env[65471]: INFO networking_nsxv3.common.synchronization [None req-90541c1d-bf7f-4f92-bd87-730e5bdf1ddb None None] Enqueued Resource ID: e7d1ed8f-7477-429a-a37e-14104f890477 with Priority: HIGHEST for action port [ 714.529781] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7d1ed8f-7477-429a-a37e-14104f890477 with Priority: HIGHEST for action port [ 714.530463] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-e7d1ed8f-7477-429a-a37e-14104f890477 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.530580] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e7d1ed8f-7477-429a-a37e-14104f890477" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.530637] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e7d1ed8f-7477-429a-a37e-14104f890477" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.530855] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e7d1ed8f-7477-429a-a37e-14104f890477" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.530934] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7d1ed8f-7477-429a-a37e-14104f890477',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.674328] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.674512] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.674601] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.676341] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.676557] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.676673] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.676762] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.676959] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.677082] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.677186] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.677280] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('15cae89a-6005-4f02-95eb-d04ef2f8ea8e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.744028] env[65471]: INFO networking_nsxv3.common.synchronization [req-fa3becfd-4c5c-4c32-aead-817d3cb095f2 req-27f46b3f-1ec1-42ca-81ba-a72a3a8517e1 service nova] Enqueued Resource ID: a3c5f688-9271-4722-84e9-69667c674933 with Priority: HIGHEST for action security_group_rules [ 714.744253] env[65471]: INFO networking_nsxv3.common.synchronization [req-fa3becfd-4c5c-4c32-aead-817d3cb095f2 req-27f46b3f-1ec1-42ca-81ba-a72a3a8517e1 service nova] Enqueued Resource ID: a3c5f688-9271-4722-84e9-69667c674933 with Priority: HIGHEST for action security_group_members [ 714.744444] env[65471]: INFO networking_nsxv3.common.synchronization [req-fa3becfd-4c5c-4c32-aead-817d3cb095f2 req-27f46b3f-1ec1-42ca-81ba-a72a3a8517e1 service nova] Enqueued Resource ID: 4386c92e-7201-44b5-9eb5-c6e522ceb69d with Priority: HIGHEST for action port [ 714.745523] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3c5f688-9271-4722-84e9-69667c674933 with Priority: HIGHEST for action security_group_rules [ 714.745733] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3c5f688-9271-4722-84e9-69667c674933 with Priority: HIGHEST for action security_group_members [ 714.747331] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4386c92e-7201-44b5-9eb5-c6e522ceb69d with Priority: HIGHEST for action port [ 714.747331] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a3c5f688-9271-4722-84e9-69667c674933 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.747331] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.747331] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.751183] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.751183] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a3c5f688-9271-4722-84e9-69667c674933',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.751183] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3c5f688-9271-4722-84e9-69667c674933 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.751183] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.751183] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.751183] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.751183] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.751183] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.751183] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.751183] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.751183] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.751495] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a3c5f688-9271-4722-84e9-69667c674933',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.752377] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-4386c92e-7201-44b5-9eb5-c6e522ceb69d taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.752542] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4386c92e-7201-44b5-9eb5-c6e522ceb69d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.752598] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4386c92e-7201-44b5-9eb5-c6e522ceb69d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.752796] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4386c92e-7201-44b5-9eb5-c6e522ceb69d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.752873] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4386c92e-7201-44b5-9eb5-c6e522ceb69d',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.033585] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e7d1ed8f-7477-429a-a37e-14104f890477 [ 715.034330] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.034526] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.034601] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.034825] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.034922] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.035035] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e7d1ed8f-7477-429a-a37e-14104f890477 already deleted. [ 715.035111] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e7d1ed8f-7477-429a-a37e-14104f890477" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.113948] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7dafcbc-15be-4704-ad92-28657ead70aa in Status: SUCCESS [ 715.114287] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.114486] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.114734] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.114930] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.115070] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.115145] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.115296] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.115531] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.115531] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.115531] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f7dafcbc-15be-4704-ad92-28657ead70aa',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.179699] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.179699] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.179988] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.179988] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.180200] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.180310] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.180374] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.180530] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.180617] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.180704] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.180912] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.181312] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.181312] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.181695] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.181780] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.181956] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.181956] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.182639] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.182761] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.182912] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.183198] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('15cae89a-6005-4f02-95eb-d04ef2f8ea8e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.189051] env[65471]: INFO networking_nsxv3.common.synchronization [req-bde300d4-d748-42bd-861e-15fd2209a201 req-b15c70cd-f3d5-4065-a5e6-a502167c703c tempest-FloatingIPsAssociationTestJSON-777761534 tempest-FloatingIPsAssociationTestJSON-777761534-project-member] Enqueued Resource ID: fc157df5-294c-4a29-82ae-e1ec842611f3 with Priority: HIGHEST for action security_group_members [ 715.189051] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc157df5-294c-4a29-82ae-e1ec842611f3 with Priority: HIGHEST for action security_group_members [ 715.189051] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc157df5-294c-4a29-82ae-e1ec842611f3 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.189051] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc157df5-294c-4a29-82ae-e1ec842611f3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.189051] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc157df5-294c-4a29-82ae-e1ec842611f3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.189424] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc157df5-294c-4a29-82ae-e1ec842611f3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.189563] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.190146] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.190276] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.190567] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.190657] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.190805] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc157df5-294c-4a29-82ae-e1ec842611f3',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.255345] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a3c5f688-9271-4722-84e9-69667c674933',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.256758] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3c5f688-9271-4722-84e9-69667c674933 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.256865] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.258201] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4386c92e-7201-44b5-9eb5-c6e522ceb69d with status ACTIVE [ 715.258387] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.258504] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.258591] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.258829] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.258921] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.259202] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.259353] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.259419] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.260551] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.260727] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.260960] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.261081] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.261147] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.261303] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.261382] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.261475] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4386c92e-7201-44b5-9eb5-c6e522ceb69d is going to be updated. [ 715.287853] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.287989] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.288111] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.288360] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.288515] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.288728] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4386c92e-7201-44b5-9eb5-c6e522ceb69d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.548131] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock network-246 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.548131] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "network-246" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.548343] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "network-246" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.550371] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "network-246" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.551100] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.551100] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.551100] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.551270] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.551447] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.551675] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 715.551783] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 715.551888] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 715.551990] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 715.552104] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 715.552201] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 715.553588] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 715.572123] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 715.572834] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 715.572834] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 715.572834] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "network-246" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.573020] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock port-9c606682-bdaa-4a51-a0f6-ddb71c7b3abd taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.573020] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "port-9c606682-bdaa-4a51-a0f6-ddb71c7b3abd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.573136] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "port-9c606682-bdaa-4a51-a0f6-ddb71c7b3abd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.573509] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "port-9c606682-bdaa-4a51-a0f6-ddb71c7b3abd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.573636] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c606682-bdaa-4a51-a0f6-ddb71c7b3abd',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.620504] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f7dafcbc-15be-4704-ad92-28657ead70aa',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.674035] env[65471]: INFO networking_nsxv3.common.synchronization [None req-e3e55697-f63d-4dc4-87f7-7b6e4cb59173 tempest-ServersTestBootFromVolume-1192670064 tempest-ServersTestBootFromVolume-1192670064-project-member] Enqueued Resource ID: 58316ca3-525d-4197-969c-1e363b6969c6 with Priority: HIGHEST for action security_group_rules [ 715.674928] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58316ca3-525d-4197-969c-1e363b6969c6 with Priority: HIGHEST for action security_group_rules [ 715.675494] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-58316ca3-525d-4197-969c-1e363b6969c6 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.675835] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-58316ca3-525d-4197-969c-1e363b6969c6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.676838] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-58316ca3-525d-4197-969c-1e363b6969c6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.676838] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-58316ca3-525d-4197-969c-1e363b6969c6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.676838] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('58316ca3-525d-4197-969c-1e363b6969c6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.688576] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 15cae89a-6005-4f02-95eb-d04ef2f8ea8e: rpc.has_security_group_logging(os_id): False [ 715.693423] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fc157df5-294c-4a29-82ae-e1ec842611f3',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.710751] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.711039] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.711039] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.711210] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.713388] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.713388] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.713388] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.713388] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.713388] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.713388] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.713388] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.713388] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.713388] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.713388] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.713388] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.717166] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.717326] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.717407] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.717520] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.717612] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.717732] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15cae89a-6005-4f02-95eb-d04ef2f8ea8e is going to be updated. [ 715.766882] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a3c5f688-9271-4722-84e9-69667c674933',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.788207] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.788207] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.788360] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.788522] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.788683] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.804239] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15cae89a-6005-4f02-95eb-d04ef2f8ea8e in Status: IN_PROGRESS for 2s [ 715.819123] env[65471]: INFO networking_nsxv3.common.synchronization [None req-c27033e4-9700-4220-a65f-8b9819ce0915 tempest-ServersTestBootFromVolume-1192670064 tempest-ServersTestBootFromVolume-1192670064-project-member] Enqueued Resource ID: 58316ca3-525d-4197-969c-1e363b6969c6 with Priority: HIGHEST for action security_group_rules [ 715.819530] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58316ca3-525d-4197-969c-1e363b6969c6 with Priority: HIGHEST for action security_group_rules [ 715.819873] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-58316ca3-525d-4197-969c-1e363b6969c6 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.820070] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-58316ca3-525d-4197-969c-1e363b6969c6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.906570] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69a8cc18-3d2c-4522-9688-4b5525d659e0 in Status: SUCCESS [ 715.906570] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69a8cc18-3d2c-4522-9688-4b5525d659e0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.076022] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.076322] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.076517] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.076863] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.077063] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.077251] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Segment Port 9c606682-bdaa-4a51-a0f6-ddb71c7b3abd not found, creating... [ 716.077527] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.077682] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.077794] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.078059] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.078197] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.078472] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.078619] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.078729] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.078927] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.079151] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.079328] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Resource: SegmentPort with ID: 9c606682-bdaa-4a51-a0f6-ddb71c7b3abd is going to be created. [ 716.105927] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.106247] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.106438] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.106807] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.107132] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.107446] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "port-9c606682-bdaa-4a51-a0f6-ddb71c7b3abd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.123410] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f7dafcbc-15be-4704-ad92-28657ead70aa: rpc.has_security_group_logging(os_id): False [ 716.145259] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.145259] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.145259] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.145259] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.145259] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.145637] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.145637] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.145637] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.145841] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.145977] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.146098] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7dafcbc-15be-4704-ad92-28657ead70aa is going to be created. [ 716.195346] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fc157df5-294c-4a29-82ae-e1ec842611f3',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.209791] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.210033] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.210033] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.210276] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.210383] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.210485] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58316ca3-525d-4197-969c-1e363b6969c6 already deleted. [ 716.210570] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-58316ca3-525d-4197-969c-1e363b6969c6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.210761] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-58316ca3-525d-4197-969c-1e363b6969c6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.210940] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-58316ca3-525d-4197-969c-1e363b6969c6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.211063] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('58316ca3-525d-4197-969c-1e363b6969c6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.254028] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.254243] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.254284] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.254488] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.254655] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.269051] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.269229] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.269343] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.269526] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.269616] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.269713] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3c5f688-9271-4722-84e9-69667c674933 is going to be created. [ 716.275665] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7dafcbc-15be-4704-ad92-28657ead70aa in Status: IN_PROGRESS for 2s [ 716.303755] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.303974] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.304051] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.304255] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.304446] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.324032] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3c5f688-9271-4722-84e9-69667c674933 in Status: UNINITIALIZED for 2s [ 716.700461] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.700461] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.700461] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.700461] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.700461] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.700461] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc157df5-294c-4a29-82ae-e1ec842611f3 is going to be updated. [ 716.729079] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.729079] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.729079] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.730356] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.730356] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.733112] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.733414] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.734751] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.734751] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.734751] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.734751] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58316ca3-525d-4197-969c-1e363b6969c6 already deleted. [ 716.734751] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-58316ca3-525d-4197-969c-1e363b6969c6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.742194] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc157df5-294c-4a29-82ae-e1ec842611f3 in Status: IN_PROGRESS for 2s [ 716.809697] env[65471]: INFO networking_nsxv3.common.synchronization [req-bde300d4-d748-42bd-861e-15fd2209a201 req-346d85f9-975c-427a-bbe6-e5cdf05c7c9f service nova] Enqueued Resource ID: fc157df5-294c-4a29-82ae-e1ec842611f3 with Priority: HIGHEST for action security_group_rules [ 716.809877] env[65471]: INFO networking_nsxv3.common.synchronization [req-bde300d4-d748-42bd-861e-15fd2209a201 req-346d85f9-975c-427a-bbe6-e5cdf05c7c9f service nova] Enqueued Resource ID: fc157df5-294c-4a29-82ae-e1ec842611f3 with Priority: HIGHEST for action security_group_members [ 716.810420] env[65471]: INFO networking_nsxv3.common.synchronization [req-bde300d4-d748-42bd-861e-15fd2209a201 req-346d85f9-975c-427a-bbe6-e5cdf05c7c9f service nova] Enqueued Resource ID: 9c606682-bdaa-4a51-a0f6-ddb71c7b3abd with Priority: HIGHEST for action port [ 716.811124] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc157df5-294c-4a29-82ae-e1ec842611f3 with Priority: HIGHEST for action security_group_rules [ 716.811322] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc157df5-294c-4a29-82ae-e1ec842611f3 with Priority: HIGHEST for action security_group_members [ 716.811953] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c606682-bdaa-4a51-a0f6-ddb71c7b3abd with Priority: HIGHEST for action port [ 716.812328] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fc157df5-294c-4a29-82ae-e1ec842611f3 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.812510] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fc157df5-294c-4a29-82ae-e1ec842611f3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.812602] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fc157df5-294c-4a29-82ae-e1ec842611f3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.812852] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fc157df5-294c-4a29-82ae-e1ec842611f3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.812957] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fc157df5-294c-4a29-82ae-e1ec842611f3',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.814056] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc157df5-294c-4a29-82ae-e1ec842611f3 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.814056] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc157df5-294c-4a29-82ae-e1ec842611f3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.814305] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-9c606682-bdaa-4a51-a0f6-ddb71c7b3abd taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.814446] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9c606682-bdaa-4a51-a0f6-ddb71c7b3abd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.814570] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9c606682-bdaa-4a51-a0f6-ddb71c7b3abd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.814737] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9c606682-bdaa-4a51-a0f6-ddb71c7b3abd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.814831] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c606682-bdaa-4a51-a0f6-ddb71c7b3abd',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.316509] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc157df5-294c-4a29-82ae-e1ec842611f3 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.318318] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc157df5-294c-4a29-82ae-e1ec842611f3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.318318] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9c606682-bdaa-4a51-a0f6-ddb71c7b3abd with status ACTIVE [ 717.318318] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.318318] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.318318] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.318318] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.318683] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.318683] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.318683] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.318786] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.318910] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.318976] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.319124] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.319213] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.319271] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.319408] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.319484] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.319560] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9c606682-bdaa-4a51-a0f6-ddb71c7b3abd is going to be updated. [ 717.347046] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.347283] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.347283] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.347462] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.347591] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.348181] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9c606682-bdaa-4a51-a0f6-ddb71c7b3abd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.755914] env[65471]: INFO networking_nsxv3.common.synchronization [req-4b5f488b-1407-484c-96c3-1c4e9db3a461 req-0f9e2f1d-f744-4bff-b1d3-76716defe306 tempest-FloatingIPsAssociationNegativeTestJSON-836224756 tempest-FloatingIPsAssociationNegativeTestJSON-836224756-project-member] Enqueued Resource ID: a976012d-6558-47ff-8d35-cffeac52b05f with Priority: HIGHEST for action security_group_members [ 717.756284] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a976012d-6558-47ff-8d35-cffeac52b05f with Priority: HIGHEST for action security_group_members [ 717.756466] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-a976012d-6558-47ff-8d35-cffeac52b05f taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.756585] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a976012d-6558-47ff-8d35-cffeac52b05f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.756650] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a976012d-6558-47ff-8d35-cffeac52b05f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.756901] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a976012d-6558-47ff-8d35-cffeac52b05f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.757070] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.757162] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.757229] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.757374] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.757457] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.757546] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a976012d-6558-47ff-8d35-cffeac52b05f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.825232] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15cae89a-6005-4f02-95eb-d04ef2f8ea8e in Status: SUCCESS [ 717.825537] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.140556] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock network-911 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.140556] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "network-911" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.140781] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "network-911" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.140974] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "network-911" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.142582] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.142582] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.142582] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.142582] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.142582] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.142582] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 718.142582] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 718.142582] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 718.142582] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 718.143138] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 718.143138] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 718.143138] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 718.163508] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 718.163654] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 718.163742] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 718.163988] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "network-911" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.164316] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock port-fc36ccd4-361c-4d47-98d5-098f59f2f051 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.164499] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "port-fc36ccd4-361c-4d47-98d5-098f59f2f051" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.164610] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "port-fc36ccd4-361c-4d47-98d5-098f59f2f051" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.164935] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "port-fc36ccd4-361c-4d47-98d5-098f59f2f051" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.165100] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc36ccd4-361c-4d47-98d5-098f59f2f051',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.260135] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.260386] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.260486] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.260758] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.260871] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.261123] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.261338] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.261338] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.261567] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.261567] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.261622] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a976012d-6558-47ff-8d35-cffeac52b05f already deleted. [ 718.261696] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a976012d-6558-47ff-8d35-cffeac52b05f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.292573] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7dafcbc-15be-4704-ad92-28657ead70aa in Status: SUCCESS [ 718.292820] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.337697] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3c5f688-9271-4722-84e9-69667c674933 in Status: SUCCESS [ 718.337981] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.338141] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.338540] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.338763] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.338905] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.338947] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.339200] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.339297] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.339389] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.339484] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a3c5f688-9271-4722-84e9-69667c674933',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.668403] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.668621] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.668740] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.669027] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.669176] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.669332] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Segment Port fc36ccd4-361c-4d47-98d5-098f59f2f051 not found, creating... [ 718.669590] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.669743] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.669852] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.671090] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.671090] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.671090] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.671090] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.671090] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.672022] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.672022] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.672118] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Resource: SegmentPort with ID: fc36ccd4-361c-4d47-98d5-098f59f2f051 is going to be created. [ 718.692583] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.692819] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.692920] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.693224] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.693455] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.693676] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "port-fc36ccd4-361c-4d47-98d5-098f59f2f051" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.751906] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc157df5-294c-4a29-82ae-e1ec842611f3 in Status: SUCCESS [ 718.752111] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc157df5-294c-4a29-82ae-e1ec842611f3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.752292] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc157df5-294c-4a29-82ae-e1ec842611f3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.752525] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc157df5-294c-4a29-82ae-e1ec842611f3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.752722] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.752850] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.752911] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.753081] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.753159] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.753256] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc157df5-294c-4a29-82ae-e1ec842611f3',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.843381] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3c5f688-9271-4722-84e9-69667c674933 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.843603] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.843603] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.843846] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.844085] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.844297] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.844297] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.844465] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.844520] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.844572] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.844721] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3c5f688-9271-4722-84e9-69667c674933 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.844822] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.844887] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.845072] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.845218] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.845315] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.845369] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.845715] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.845715] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.845715] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.845886] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a3c5f688-9271-4722-84e9-69667c674933',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.255190] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fc157df5-294c-4a29-82ae-e1ec842611f3',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.348405] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a3c5f688-9271-4722-84e9-69667c674933: rpc.has_security_group_logging(os_id): False [ 719.370938] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.371223] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.371352] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.371638] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.371784] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.372063] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.372267] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.372312] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.372519] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.372680] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.372893] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.374059] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.374059] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.374760] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.375281] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.375515] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.375622] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.375943] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.375943] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.375943] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.376054] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a3c5f688-9271-4722-84e9-69667c674933 is going to be created. [ 719.456941] env[65471]: INFO networking_nsxv3.common.synchronization [req-4b5f488b-1407-484c-96c3-1c4e9db3a461 req-6ee829d3-7b59-4582-b5cd-fc38e3a49c64 service nova] Enqueued Resource ID: a976012d-6558-47ff-8d35-cffeac52b05f with Priority: HIGHEST for action security_group_rules [ 719.457251] env[65471]: INFO networking_nsxv3.common.synchronization [req-4b5f488b-1407-484c-96c3-1c4e9db3a461 req-6ee829d3-7b59-4582-b5cd-fc38e3a49c64 service nova] Enqueued Resource ID: a976012d-6558-47ff-8d35-cffeac52b05f with Priority: HIGHEST for action security_group_members [ 719.457465] env[65471]: INFO networking_nsxv3.common.synchronization [req-4b5f488b-1407-484c-96c3-1c4e9db3a461 req-6ee829d3-7b59-4582-b5cd-fc38e3a49c64 service nova] Enqueued Resource ID: fc36ccd4-361c-4d47-98d5-098f59f2f051 with Priority: HIGHEST for action port [ 719.458694] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a976012d-6558-47ff-8d35-cffeac52b05f with Priority: HIGHEST for action security_group_rules [ 719.459208] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a976012d-6558-47ff-8d35-cffeac52b05f with Priority: HIGHEST for action security_group_members [ 719.459208] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc36ccd4-361c-4d47-98d5-098f59f2f051 with Priority: HIGHEST for action port [ 719.459862] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a976012d-6558-47ff-8d35-cffeac52b05f taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.459862] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a976012d-6558-47ff-8d35-cffeac52b05f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.460249] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a976012d-6558-47ff-8d35-cffeac52b05f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.461035] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a976012d-6558-47ff-8d35-cffeac52b05f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.461035] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a976012d-6558-47ff-8d35-cffeac52b05f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.461538] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-a976012d-6558-47ff-8d35-cffeac52b05f taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.461830] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a976012d-6558-47ff-8d35-cffeac52b05f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.461962] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a976012d-6558-47ff-8d35-cffeac52b05f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.462247] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a976012d-6558-47ff-8d35-cffeac52b05f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.462530] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.462695] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.464502] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.464502] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.464502] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.464502] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a976012d-6558-47ff-8d35-cffeac52b05f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.465784] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc36ccd4-361c-4d47-98d5-098f59f2f051 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.467213] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc36ccd4-361c-4d47-98d5-098f59f2f051" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.467213] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc36ccd4-361c-4d47-98d5-098f59f2f051" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.467213] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc36ccd4-361c-4d47-98d5-098f59f2f051" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.467213] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc36ccd4-361c-4d47-98d5-098f59f2f051',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.527517] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.529995] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.530345] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.530684] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.530986] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.550098] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a3c5f688-9271-4722-84e9-69667c674933 in Status: IN_PROGRESS for 2s [ 719.757791] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fc157df5-294c-4a29-82ae-e1ec842611f3',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.970490] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-a976012d-6558-47ff-8d35-cffeac52b05f taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.970490] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a976012d-6558-47ff-8d35-cffeac52b05f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.970490] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a976012d-6558-47ff-8d35-cffeac52b05f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.970640] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fc36ccd4-361c-4d47-98d5-098f59f2f051 with status ACTIVE [ 719.970898] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.971051] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.971170] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.971426] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.971621] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.971774] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.971892] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.972798] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.972798] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.972798] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.972798] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.972798] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.972798] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.973095] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.973095] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.973095] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fc36ccd4-361c-4d47-98d5-098f59f2f051 is going to be updated. [ 720.011207] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.011422] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.011499] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.011913] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.012114] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.012254] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc36ccd4-361c-4d47-98d5-098f59f2f051" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.260647] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.260647] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.260872] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.261164] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.261283] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.261401] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc157df5-294c-4a29-82ae-e1ec842611f3 is going to be updated. [ 720.320194] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.320615] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.320615] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.321085] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.321456] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.345865] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc157df5-294c-4a29-82ae-e1ec842611f3 in Status: IN_PROGRESS for 2s [ 720.475592] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a976012d-6558-47ff-8d35-cffeac52b05f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.977633] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.977822] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.978391] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.978391] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.978391] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.978602] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a976012d-6558-47ff-8d35-cffeac52b05f is going to be created. [ 721.006600] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.006750] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.006827] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.007064] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.007321] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.018790] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a976012d-6558-47ff-8d35-cffeac52b05f in Status: UNINITIALIZED for 2s [ 721.565395] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a3c5f688-9271-4722-84e9-69667c674933 in Status: SUCCESS [ 721.565825] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.748049] env[65471]: INFO networking_nsxv3.common.synchronization [req-3a9ea606-5b68-4093-b191-36d493112dc0 req-82f3fca6-e3c9-41ec-8ac8-0b4d015e5f21 tempest-SecurityGroupsTestJSON-778312627 tempest-SecurityGroupsTestJSON-778312627-project-member] Enqueued Resource ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 with Priority: HIGHEST for action security_group_members [ 721.749477] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 with Priority: HIGHEST for action security_group_members [ 721.749689] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.749854] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.749962] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.750312] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.750513] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.750659] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.750751] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.752103] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.752103] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.752103] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b60bf9ef-6e65-4c6d-87e2-33b6bcafa939',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.258459] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.262192] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.262396] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.262702] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.262851] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.263089] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.263251] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.263350] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.264173] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.264173] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.264173] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 already deleted. [ 722.264173] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.360324] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc157df5-294c-4a29-82ae-e1ec842611f3 in Status: SUCCESS [ 722.360324] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc157df5-294c-4a29-82ae-e1ec842611f3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.360324] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc157df5-294c-4a29-82ae-e1ec842611f3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.361423] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc157df5-294c-4a29-82ae-e1ec842611f3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.361423] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.361423] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.361423] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.361423] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.361423] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.361726] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc157df5-294c-4a29-82ae-e1ec842611f3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.361726] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fc157df5-294c-4a29-82ae-e1ec842611f3',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.536981] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock network-134 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.537567] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "network-134" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.537902] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "network-134" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.538558] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "network-134" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.539121] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.540022] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.541950] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.543606] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.543606] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.543606] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 722.543606] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 722.543606] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 722.544297] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 722.544545] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 722.544753] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 722.544993] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 722.576913] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 722.577344] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 722.577390] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 722.580169] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "network-134" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.580169] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock port-8620d30a-1e37-477f-b4de-27e8195fa6e0 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.580169] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "port-8620d30a-1e37-477f-b4de-27e8195fa6e0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.580169] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "port-8620d30a-1e37-477f-b4de-27e8195fa6e0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.580169] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "port-8620d30a-1e37-477f-b4de-27e8195fa6e0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.580169] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8620d30a-1e37-477f-b4de-27e8195fa6e0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.868589] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc157df5-294c-4a29-82ae-e1ec842611f3 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.868589] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc157df5-294c-4a29-82ae-e1ec842611f3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.868589] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc157df5-294c-4a29-82ae-e1ec842611f3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.868851] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc157df5-294c-4a29-82ae-e1ec842611f3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.868973] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.869110] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.869110] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.869258] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.869352] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.869420] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc157df5-294c-4a29-82ae-e1ec842611f3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.869536] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc157df5-294c-4a29-82ae-e1ec842611f3 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.869633] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc157df5-294c-4a29-82ae-e1ec842611f3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.869699] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc157df5-294c-4a29-82ae-e1ec842611f3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.869803] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc157df5-294c-4a29-82ae-e1ec842611f3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.869936] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.870122] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.870206] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.870341] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.870422] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.870502] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc157df5-294c-4a29-82ae-e1ec842611f3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.870594] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fc157df5-294c-4a29-82ae-e1ec842611f3',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.029743] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a976012d-6558-47ff-8d35-cffeac52b05f in Status: SUCCESS [ 723.030133] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a976012d-6558-47ff-8d35-cffeac52b05f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.030330] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a976012d-6558-47ff-8d35-cffeac52b05f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.030556] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a976012d-6558-47ff-8d35-cffeac52b05f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.030832] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.030983] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.031075] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.031270] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.031353] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.031437] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a976012d-6558-47ff-8d35-cffeac52b05f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.031531] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a976012d-6558-47ff-8d35-cffeac52b05f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.082428] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.082625] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.082771] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.083052] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.083207] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.083361] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Segment Port 8620d30a-1e37-477f-b4de-27e8195fa6e0 not found, creating... [ 723.083625] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.083780] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.083893] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.084143] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.084278] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.084644] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.084826] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.084938] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.085166] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.085291] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.085458] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Resource: SegmentPort with ID: 8620d30a-1e37-477f-b4de-27e8195fa6e0 is going to be created. [ 723.110464] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.110851] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.111088] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.111561] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.111961] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.112354] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "port-8620d30a-1e37-477f-b4de-27e8195fa6e0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.372659] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fc157df5-294c-4a29-82ae-e1ec842611f3: rpc.has_security_group_logging(os_id): False [ 723.394784] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.395025] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.395204] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.395408] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.417525] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.417755] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.418059] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.418059] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.418321] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.418451] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.418729] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.418864] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.418952] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.419147] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.419238] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.419450] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.419551] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.419654] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.419763] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.419855] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.419946] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fc157df5-294c-4a29-82ae-e1ec842611f3 is going to be updated. [ 723.519784] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.520736] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.520966] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.521243] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.521405] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.535472] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-a976012d-6558-47ff-8d35-cffeac52b05f taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.535647] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a976012d-6558-47ff-8d35-cffeac52b05f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.535737] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a976012d-6558-47ff-8d35-cffeac52b05f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.535922] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a976012d-6558-47ff-8d35-cffeac52b05f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.536116] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.536222] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.536289] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.536464] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.536567] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.536621] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a976012d-6558-47ff-8d35-cffeac52b05f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.536787] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-a976012d-6558-47ff-8d35-cffeac52b05f taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.536872] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a976012d-6558-47ff-8d35-cffeac52b05f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.536934] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a976012d-6558-47ff-8d35-cffeac52b05f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.537052] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a976012d-6558-47ff-8d35-cffeac52b05f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.537191] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.537320] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.537362] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.537584] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.537584] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.537642] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a976012d-6558-47ff-8d35-cffeac52b05f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.537726] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a976012d-6558-47ff-8d35-cffeac52b05f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.540743] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc157df5-294c-4a29-82ae-e1ec842611f3 in Status: IN_PROGRESS for 2s [ 723.880243] env[65471]: INFO networking_nsxv3.common.synchronization [req-3a9ea606-5b68-4093-b191-36d493112dc0 req-869ff427-f21b-45d0-930f-0363deb2a8be service nova] Enqueued Resource ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 with Priority: HIGHEST for action security_group_rules [ 723.880531] env[65471]: INFO networking_nsxv3.common.synchronization [req-3a9ea606-5b68-4093-b191-36d493112dc0 req-869ff427-f21b-45d0-930f-0363deb2a8be service nova] Enqueued Resource ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 with Priority: HIGHEST for action security_group_members [ 723.880586] env[65471]: INFO networking_nsxv3.common.synchronization [req-3a9ea606-5b68-4093-b191-36d493112dc0 req-869ff427-f21b-45d0-930f-0363deb2a8be service nova] Enqueued Resource ID: 8620d30a-1e37-477f-b4de-27e8195fa6e0 with Priority: HIGHEST for action port [ 723.881257] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 with Priority: HIGHEST for action security_group_rules [ 723.881325] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 with Priority: HIGHEST for action security_group_members [ 723.881461] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8620d30a-1e37-477f-b4de-27e8195fa6e0 with Priority: HIGHEST for action port [ 723.884066] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.884066] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.884066] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.884066] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.884066] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b60bf9ef-6e65-4c6d-87e2-33b6bcafa939',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.884066] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.884066] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.884560] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.884560] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.884959] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.884959] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.884959] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.886554] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.886686] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.886810] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b60bf9ef-6e65-4c6d-87e2-33b6bcafa939',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.887704] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-8620d30a-1e37-477f-b4de-27e8195fa6e0 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.888238] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8620d30a-1e37-477f-b4de-27e8195fa6e0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.888328] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8620d30a-1e37-477f-b4de-27e8195fa6e0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.889269] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8620d30a-1e37-477f-b4de-27e8195fa6e0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.889663] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8620d30a-1e37-477f-b4de-27e8195fa6e0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.039908] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a976012d-6558-47ff-8d35-cffeac52b05f: rpc.has_security_group_logging(os_id): False [ 724.059424] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.059565] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.059635] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.059851] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.059942] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.060206] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.060309] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.060372] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.060526] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.060604] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.060788] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.060920] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.060956] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.061084] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.061162] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.061337] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.061427] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.061486] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.061626] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.061687] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.061771] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a976012d-6558-47ff-8d35-cffeac52b05f is going to be created. [ 724.130771] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.130771] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.130771] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.130771] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.130771] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.144452] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a976012d-6558-47ff-8d35-cffeac52b05f in Status: IN_PROGRESS for 2s [ 724.337626] env[65471]: INFO networking_nsxv3.common.synchronization [req-6f69cf22-012b-4f5b-be60-d57dba7e72e6 req-80a0c94e-f853-459c-bde4-bed0c1214470 tempest-ServerRescueTestJSONUnderV235-906155078 tempest-ServerRescueTestJSONUnderV235-906155078-project-member] Enqueued Resource ID: 7cefc497-117e-45da-bc1f-1ab0ea166d74 with Priority: HIGHEST for action security_group_members [ 724.338226] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cefc497-117e-45da-bc1f-1ab0ea166d74 with Priority: HIGHEST for action security_group_members [ 724.338560] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cefc497-117e-45da-bc1f-1ab0ea166d74 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.338680] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.338754] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.339831] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.339831] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.339831] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.339831] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.339831] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.339831] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.339831] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7cefc497-117e-45da-bc1f-1ab0ea166d74',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.391644] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.391847] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.391972] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b60bf9ef-6e65-4c6d-87e2-33b6bcafa939',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.393307] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8620d30a-1e37-477f-b4de-27e8195fa6e0 with status ACTIVE [ 724.393408] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.394099] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.394099] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.394099] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.394099] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.394099] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.394463] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.394463] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.394463] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.394463] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.394667] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.394742] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.394795] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.394914] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.395020] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.395066] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8620d30a-1e37-477f-b4de-27e8195fa6e0 is going to be updated. [ 724.419633] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.419775] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.419839] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.420099] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.420273] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.420438] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8620d30a-1e37-477f-b4de-27e8195fa6e0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.549171] env[65471]: INFO networking_nsxv3.common.synchronization [req-c0e5111a-64b9-4d71-a3d7-d29ee90a36f3 req-ab7b091d-6862-4a04-ad14-595670833cbc tempest-ListServersNegativeTestJSON-604387842 tempest-ListServersNegativeTestJSON-604387842-project-member] Enqueued Resource ID: 15cae89a-6005-4f02-95eb-d04ef2f8ea8e with Priority: HIGHEST for action security_group_members [ 724.549476] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15cae89a-6005-4f02-95eb-d04ef2f8ea8e with Priority: HIGHEST for action security_group_members [ 724.549966] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.550336] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.550531] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.550827] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.551177] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.551459] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.551623] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.551958] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.552214] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.552446] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15cae89a-6005-4f02-95eb-d04ef2f8ea8e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.845417] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.845417] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.845417] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.845417] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.845417] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.845417] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.845417] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.845417] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.849891] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.849891] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.849891] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7cefc497-117e-45da-bc1f-1ab0ea166d74 is going to be updated. [ 724.888655] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.888655] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.888655] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.888655] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.888655] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.898223] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b60bf9ef-6e65-4c6d-87e2-33b6bcafa939',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.903402] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cefc497-117e-45da-bc1f-1ab0ea166d74 in Status: IN_PROGRESS for 2s [ 725.056034] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15cae89a-6005-4f02-95eb-d04ef2f8ea8e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.215579] env[65471]: INFO networking_nsxv3.common.synchronization [req-4e5712f0-289e-4820-b093-8470879d36ef req-580eaad8-4354-447a-af73-583800956284 tempest-ImagesOneServerTestJSON-1788246232 tempest-ImagesOneServerTestJSON-1788246232-project-member] Enqueued Resource ID: 50c2c28e-c8d2-4f9e-a431-6df336da2df5 with Priority: HIGHEST for action security_group_members [ 725.215579] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50c2c28e-c8d2-4f9e-a431-6df336da2df5 with Priority: HIGHEST for action security_group_members [ 725.215579] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-50c2c28e-c8d2-4f9e-a431-6df336da2df5 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.215579] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50c2c28e-c8d2-4f9e-a431-6df336da2df5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.215579] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50c2c28e-c8d2-4f9e-a431-6df336da2df5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.216339] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50c2c28e-c8d2-4f9e-a431-6df336da2df5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.217537] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.217636] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.217636] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.217832] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.217917] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.218051] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50c2c28e-c8d2-4f9e-a431-6df336da2df5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.402113] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.402644] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.402644] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.402644] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.402644] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.402644] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 is going to be created. [ 725.434372] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.434501] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.434792] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.436016] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.436016] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.454185] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 in Status: UNINITIALIZED for 2s [ 725.556896] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc157df5-294c-4a29-82ae-e1ec842611f3 in Status: SUCCESS [ 725.556896] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fc157df5-294c-4a29-82ae-e1ec842611f3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.560788] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15cae89a-6005-4f02-95eb-d04ef2f8ea8e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.721943] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.722125] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.722199] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.722449] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.751020] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.751020] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.751020] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.751020] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.751020] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.751020] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.751020] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50c2c28e-c8d2-4f9e-a431-6df336da2df5 is going to be updated. [ 725.781182] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.781385] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.781460] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.781748] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.782172] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.792689] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50c2c28e-c8d2-4f9e-a431-6df336da2df5 in Status: IN_PROGRESS for 2s [ 726.065150] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.065150] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.065150] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.065150] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.065672] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.065868] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15cae89a-6005-4f02-95eb-d04ef2f8ea8e is going to be updated. [ 726.098901] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.098901] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.098901] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.098901] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.098901] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.107534] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15cae89a-6005-4f02-95eb-d04ef2f8ea8e in Status: IN_PROGRESS for 2s [ 726.158686] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a976012d-6558-47ff-8d35-cffeac52b05f in Status: SUCCESS [ 726.162643] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a976012d-6558-47ff-8d35-cffeac52b05f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.353400] env[65471]: INFO networking_nsxv3.common.synchronization [None req-54e64792-1140-4e70-b581-3b6d37e6bfc6 None None] Enqueued Resource ID: d8265191-bb85-4fb0-9def-ef446b42e9ed with Priority: HIGHEST for action port [ 726.353966] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8265191-bb85-4fb0-9def-ef446b42e9ed with Priority: HIGHEST for action port [ 726.354288] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-d8265191-bb85-4fb0-9def-ef446b42e9ed taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.354439] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d8265191-bb85-4fb0-9def-ef446b42e9ed" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.354470] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d8265191-bb85-4fb0-9def-ef446b42e9ed" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.354721] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d8265191-bb85-4fb0-9def-ef446b42e9ed" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.356410] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8265191-bb85-4fb0-9def-ef446b42e9ed',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.858703] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d8265191-bb85-4fb0-9def-ef446b42e9ed [ 726.858920] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.859271] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.859271] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.859371] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.859427] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.859550] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d8265191-bb85-4fb0-9def-ef446b42e9ed already deleted. [ 726.859621] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d8265191-bb85-4fb0-9def-ef446b42e9ed" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.913828] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cefc497-117e-45da-bc1f-1ab0ea166d74 in Status: SUCCESS [ 726.913828] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7cefc497-117e-45da-bc1f-1ab0ea166d74 deletion is rescheduled due to dependency. [ 726.913828] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.470314] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 in Status: SUCCESS [ 727.470314] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.470314] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.470314] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.470314] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.470314] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.470314] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.470314] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.471671] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.471671] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.471671] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b60bf9ef-6e65-4c6d-87e2-33b6bcafa939',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.806259] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50c2c28e-c8d2-4f9e-a431-6df336da2df5 in Status: SUCCESS [ 727.806445] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50c2c28e-c8d2-4f9e-a431-6df336da2df5 deletion is rescheduled due to dependency. [ 727.806558] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50c2c28e-c8d2-4f9e-a431-6df336da2df5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.975085] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.975380] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.975476] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.981037] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.981037] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.981037] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.981037] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.981037] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.981037] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.981037] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.981037] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.981037] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.981037] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.981037] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.981037] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.981037] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.981037] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.981037] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.981037] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.981037] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.981037] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b60bf9ef-6e65-4c6d-87e2-33b6bcafa939',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.995836] env[65471]: INFO networking_nsxv3.common.synchronization [req-01eeeb87-3046-458b-bcd6-ebc731e286a1 req-564e9bf4-7eec-4d6a-be67-9350c7a8d372 tempest-ServerPasswordTestJSON-1888175839 tempest-ServerPasswordTestJSON-1888175839-project-member] Enqueued Resource ID: ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a with Priority: HIGHEST for action security_group_members [ 727.996453] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a with Priority: HIGHEST for action security_group_members [ 727.998512] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.998512] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.998512] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.998767] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.999130] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.999265] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.999341] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.999517] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.999629] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.999796] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.122641] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15cae89a-6005-4f02-95eb-d04ef2f8ea8e in Status: SUCCESS [ 728.123043] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.488505] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b60bf9ef-6e65-4c6d-87e2-33b6bcafa939: rpc.has_security_group_logging(os_id): False [ 728.503719] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.505025] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.505342] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.505778] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.506436] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.506436] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.506436] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.506436] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.506824] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.506996] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.507117] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a already deleted. [ 728.507246] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.511302] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.511302] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.511591] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.511826] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.511965] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.512255] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.512414] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.512521] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.512774] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.513757] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.513757] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.513757] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.513757] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.513757] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.513757] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.513757] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.513757] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.514067] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.514635] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.515039] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.515039] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 is going to be created. [ 728.644527] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock network-25 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.644778] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "network-25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.644905] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "network-25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.645350] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "network-25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.646019] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.646352] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.646352] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.646598] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.646792] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.647040] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 728.647208] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 728.647384] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 728.647568] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 728.647742] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 728.647742] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 728.648208] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 728.702059] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 728.702364] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Cache value generated in 0.054 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 728.702490] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 728.702735] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "network-25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.703125] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock port-14ff0c9d-b00a-475e-9f31-044faf012855 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.703340] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "port-14ff0c9d-b00a-475e-9f31-044faf012855" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.703404] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "port-14ff0c9d-b00a-475e-9f31-044faf012855" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.703777] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "port-14ff0c9d-b00a-475e-9f31-044faf012855" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.703928] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14ff0c9d-b00a-475e-9f31-044faf012855',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.708963] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.709197] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.709284] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.709566] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.709777] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.727507] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 in Status: IN_PROGRESS for 2s [ 729.070897] env[65471]: INFO networking_nsxv3.common.synchronization [None req-0ea633e9-0006-4e69-84fc-f1a404723ca7 None None] Enqueued Resource ID: 82d16ae4-2616-4627-a285-456659cec6c8 with Priority: HIGHEST for action port [ 729.071873] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82d16ae4-2616-4627-a285-456659cec6c8 with Priority: HIGHEST for action port [ 729.072261] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-82d16ae4-2616-4627-a285-456659cec6c8 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.072424] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82d16ae4-2616-4627-a285-456659cec6c8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.072504] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82d16ae4-2616-4627-a285-456659cec6c8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.072755] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82d16ae4-2616-4627-a285-456659cec6c8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.072845] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82d16ae4-2616-4627-a285-456659cec6c8',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.212765] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.213088] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.213264] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.213641] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.213911] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.214245] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Segment Port 14ff0c9d-b00a-475e-9f31-044faf012855 not found, creating... [ 729.214443] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.214708] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.214911] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.215439] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.215693] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.216175] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.216439] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.216648] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.217017] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.217241] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.217466] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Resource: SegmentPort with ID: 14ff0c9d-b00a-475e-9f31-044faf012855 is going to be created. [ 729.242304] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.242591] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.242724] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.243012] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.243253] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.243500] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "port-14ff0c9d-b00a-475e-9f31-044faf012855" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.575566] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 82d16ae4-2616-4627-a285-456659cec6c8 [ 729.575566] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.575566] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.575566] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.575566] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.575566] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.575566] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:82d16ae4-2616-4627-a285-456659cec6c8 already deleted. [ 729.575566] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82d16ae4-2616-4627-a285-456659cec6c8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.938023] env[65471]: INFO networking_nsxv3.common.synchronization [req-01eeeb87-3046-458b-bcd6-ebc731e286a1 req-68e9e3c0-e420-4779-b777-0865415aea1c service nova] Enqueued Resource ID: ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a with Priority: HIGHEST for action security_group_rules [ 729.938023] env[65471]: INFO networking_nsxv3.common.synchronization [req-01eeeb87-3046-458b-bcd6-ebc731e286a1 req-68e9e3c0-e420-4779-b777-0865415aea1c service nova] Enqueued Resource ID: ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a with Priority: HIGHEST for action security_group_members [ 729.938023] env[65471]: INFO networking_nsxv3.common.synchronization [req-01eeeb87-3046-458b-bcd6-ebc731e286a1 req-68e9e3c0-e420-4779-b777-0865415aea1c service nova] Enqueued Resource ID: 14ff0c9d-b00a-475e-9f31-044faf012855 with Priority: HIGHEST for action port [ 729.938023] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a with Priority: HIGHEST for action security_group_rules [ 729.938023] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a with Priority: HIGHEST for action security_group_members [ 729.938023] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14ff0c9d-b00a-475e-9f31-044faf012855 with Priority: HIGHEST for action port [ 729.938023] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.938023] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.938023] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.938023] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.938023] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.939215] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.939517] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.939697] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.940335] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.940588] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.942178] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.942178] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.946155] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.946300] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.946463] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.948576] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-14ff0c9d-b00a-475e-9f31-044faf012855 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.948576] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-14ff0c9d-b00a-475e-9f31-044faf012855" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.948576] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-14ff0c9d-b00a-475e-9f31-044faf012855" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.948576] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-14ff0c9d-b00a-475e-9f31-044faf012855" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.948576] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14ff0c9d-b00a-475e-9f31-044faf012855',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.385768] env[65471]: INFO networking_nsxv3.common.synchronization [req-663ffe37-840e-49a5-a626-d29d6b14d942 req-261ff5fe-7dd8-4d44-8556-05bb979c5eb3 tempest-ImagesTestJSON-650286870 tempest-ImagesTestJSON-650286870-project-member] Enqueued Resource ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f with Priority: HIGHEST for action security_group_members [ 730.386642] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f with Priority: HIGHEST for action security_group_members [ 730.386970] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-85af6c5e-2f9b-491d-9584-96c44b20f99f taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.387137] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.387137] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.387414] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.387546] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.387706] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.387706] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.387859] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.387956] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.388017] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85af6c5e-2f9b-491d-9584-96c44b20f99f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.450300] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.452779] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.452779] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.452779] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 14ff0c9d-b00a-475e-9f31-044faf012855 with status ACTIVE [ 730.452779] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.452779] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.452779] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.452779] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.452779] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.452779] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.452779] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.452779] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.452779] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.452779] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.453410] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.453410] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.453410] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.453410] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.453551] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.453551] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 14ff0c9d-b00a-475e-9f31-044faf012855 is going to be updated. [ 730.488076] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.488076] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.488321] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.488396] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.488994] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.488994] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-14ff0c9d-b00a-475e-9f31-044faf012855" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.740023] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 in Status: SUCCESS [ 730.740386] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.860659] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock network-235 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.860659] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "network-235" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.860659] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "network-235" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.860659] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "network-235" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.861169] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.861303] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.861450] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.861760] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.861946] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.862217] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 730.862368] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 730.862502] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 730.862646] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 730.862796] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 730.862931] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 730.863121] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 730.883654] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 730.884170] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 730.884170] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 730.884170] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "network-235" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.884411] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock port-799b2e64-20f1-4bf4-95fd-72e2e80d928c taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.884589] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "port-799b2e64-20f1-4bf4-95fd-72e2e80d928c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.884683] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "port-799b2e64-20f1-4bf4-95fd-72e2e80d928c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.885031] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "port-799b2e64-20f1-4bf4-95fd-72e2e80d928c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.885166] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('799b2e64-20f1-4bf4-95fd-72e2e80d928c',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.890894] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.891051] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.891163] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.891379] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.891487] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.891683] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.891782] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.891843] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.891999] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.892099] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.892183] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f already deleted. [ 730.892261] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.957726] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.212912] env[65471]: INFO networking_nsxv3.common.synchronization [req-011d0ce0-fc04-4f0e-8f32-f97c61640dfd req-336d1e8d-96a6-417e-b5a3-46ea313c4918 tempest-InstanceActionsNegativeTestJSON-1472382695 tempest-InstanceActionsNegativeTestJSON-1472382695-project-member] Enqueued Resource ID: 69a8cc18-3d2c-4522-9688-4b5525d659e0 with Priority: HIGHEST for action security_group_members [ 731.214021] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69a8cc18-3d2c-4522-9688-4b5525d659e0 with Priority: HIGHEST for action security_group_members [ 731.214021] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-69a8cc18-3d2c-4522-9688-4b5525d659e0 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.214021] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69a8cc18-3d2c-4522-9688-4b5525d659e0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.214021] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69a8cc18-3d2c-4522-9688-4b5525d659e0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.214426] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69a8cc18-3d2c-4522-9688-4b5525d659e0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.214590] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.214693] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.214758] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.214907] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.214995] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.215102] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69a8cc18-3d2c-4522-9688-4b5525d659e0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.388459] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.388694] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.388810] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.389132] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.389267] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.389427] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Segment Port 799b2e64-20f1-4bf4-95fd-72e2e80d928c not found, creating... [ 731.389672] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.389825] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.389933] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.390237] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.391214] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.391214] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.391214] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.391214] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.391469] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.391469] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.391545] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Resource: SegmentPort with ID: 799b2e64-20f1-4bf4-95fd-72e2e80d928c is going to be created. [ 731.417597] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.418840] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.418840] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.418840] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.418840] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.419101] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "port-799b2e64-20f1-4bf4-95fd-72e2e80d928c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.461634] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.461821] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.461898] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.462165] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.462226] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.462352] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a is going to be created. [ 731.502510] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.502669] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.502751] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.502993] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.503192] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.524419] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a in Status: UNINITIALIZED for 2s [ 731.631029] env[65471]: INFO networking_nsxv3.common.synchronization [None req-baccb923-be51-4991-9cd2-b85014fce034 None None] Enqueued Resource ID: 9c17cf53-3763-411a-a112-6669104aaa53 with Priority: HIGHEST for action port [ 731.631673] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c17cf53-3763-411a-a112-6669104aaa53 with Priority: HIGHEST for action port [ 731.631979] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-9c17cf53-3763-411a-a112-6669104aaa53 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.632214] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9c17cf53-3763-411a-a112-6669104aaa53" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.632301] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9c17cf53-3763-411a-a112-6669104aaa53" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.632593] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9c17cf53-3763-411a-a112-6669104aaa53" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.632674] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c17cf53-3763-411a-a112-6669104aaa53',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.716771] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.719786] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.719786] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.719786] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.719786] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.719786] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.719786] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.719786] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.719786] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.719786] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.719786] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69a8cc18-3d2c-4522-9688-4b5525d659e0 is going to be updated. [ 731.767029] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.767029] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.767029] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.767029] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.767029] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.776892] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69a8cc18-3d2c-4522-9688-4b5525d659e0 in Status: IN_PROGRESS for 2s [ 731.859445] env[65471]: INFO networking_nsxv3.common.synchronization [None req-683fc041-6599-4609-9ed7-ab4199b47d8a tempest-ServersV294TestFqdnHostnames-74272933 tempest-ServersV294TestFqdnHostnames-74272933-project-member] Enqueued Resource ID: aa1e565f-d426-4783-ad96-ca42d167f6b8 with Priority: HIGHEST for action security_group_rules [ 731.860239] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa1e565f-d426-4783-ad96-ca42d167f6b8 with Priority: HIGHEST for action security_group_rules [ 731.860850] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa1e565f-d426-4783-ad96-ca42d167f6b8 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.860976] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa1e565f-d426-4783-ad96-ca42d167f6b8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.861031] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa1e565f-d426-4783-ad96-ca42d167f6b8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.861507] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa1e565f-d426-4783-ad96-ca42d167f6b8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.861507] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa1e565f-d426-4783-ad96-ca42d167f6b8',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.047034] env[65471]: INFO networking_nsxv3.common.synchronization [None req-a50a2e93-0a42-4585-b418-0c4ca6431bad tempest-ServersV294TestFqdnHostnames-74272933 tempest-ServersV294TestFqdnHostnames-74272933-project-member] Enqueued Resource ID: aa1e565f-d426-4783-ad96-ca42d167f6b8 with Priority: HIGHEST for action security_group_rules [ 732.048060] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa1e565f-d426-4783-ad96-ca42d167f6b8 with Priority: HIGHEST for action security_group_rules [ 732.048060] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa1e565f-d426-4783-ad96-ca42d167f6b8 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.048060] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa1e565f-d426-4783-ad96-ca42d167f6b8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.137305] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9c17cf53-3763-411a-a112-6669104aaa53 [ 732.137305] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.137305] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.137305] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.137305] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.137305] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.137305] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9c17cf53-3763-411a-a112-6669104aaa53 already deleted. [ 732.137305] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9c17cf53-3763-411a-a112-6669104aaa53" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.161211] env[65471]: INFO networking_nsxv3.common.synchronization [req-663ffe37-840e-49a5-a626-d29d6b14d942 req-6229c581-fa69-4367-8b70-ca272cd19219 service nova] Enqueued Resource ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f with Priority: HIGHEST for action security_group_rules [ 732.161211] env[65471]: INFO networking_nsxv3.common.synchronization [req-663ffe37-840e-49a5-a626-d29d6b14d942 req-6229c581-fa69-4367-8b70-ca272cd19219 service nova] Enqueued Resource ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f with Priority: HIGHEST for action security_group_members [ 732.161211] env[65471]: INFO networking_nsxv3.common.synchronization [req-663ffe37-840e-49a5-a626-d29d6b14d942 req-6229c581-fa69-4367-8b70-ca272cd19219 service nova] Enqueued Resource ID: 799b2e64-20f1-4bf4-95fd-72e2e80d928c with Priority: HIGHEST for action port [ 732.161211] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f with Priority: HIGHEST for action security_group_rules [ 732.161211] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f with Priority: HIGHEST for action security_group_members [ 732.161211] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 799b2e64-20f1-4bf4-95fd-72e2e80d928c with Priority: HIGHEST for action port [ 732.161211] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85af6c5e-2f9b-491d-9584-96c44b20f99f taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.161211] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.161211] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.161211] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.161211] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85af6c5e-2f9b-491d-9584-96c44b20f99f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.161853] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-85af6c5e-2f9b-491d-9584-96c44b20f99f taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.161962] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.162043] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.162222] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.162375] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.162802] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.162873] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.163096] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.163201] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.163300] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85af6c5e-2f9b-491d-9584-96c44b20f99f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.164648] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-799b2e64-20f1-4bf4-95fd-72e2e80d928c taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.164648] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-799b2e64-20f1-4bf4-95fd-72e2e80d928c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.164648] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-799b2e64-20f1-4bf4-95fd-72e2e80d928c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.164648] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-799b2e64-20f1-4bf4-95fd-72e2e80d928c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.164857] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('799b2e64-20f1-4bf4-95fd-72e2e80d928c',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.385175] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.385175] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.385175] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.385175] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.385175] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.385175] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa1e565f-d426-4783-ad96-ca42d167f6b8 already deleted. [ 732.385175] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa1e565f-d426-4783-ad96-ca42d167f6b8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.385175] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa1e565f-d426-4783-ad96-ca42d167f6b8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.386015] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa1e565f-d426-4783-ad96-ca42d167f6b8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.386285] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa1e565f-d426-4783-ad96-ca42d167f6b8',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.667721] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 799b2e64-20f1-4bf4-95fd-72e2e80d928c with status ACTIVE [ 732.667721] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.667721] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.667721] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.667721] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.667721] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.668085] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.668085] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.668085] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.668217] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.668370] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.668469] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.669396] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.669396] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.669396] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.669396] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.669396] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 799b2e64-20f1-4bf4-95fd-72e2e80d928c is going to be updated. [ 732.672081] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-85af6c5e-2f9b-491d-9584-96c44b20f99f taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.672228] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.672674] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('85af6c5e-2f9b-491d-9584-96c44b20f99f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.697024] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.697024] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.697024] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.697024] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.697024] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.697024] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-799b2e64-20f1-4bf4-95fd-72e2e80d928c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.913311] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.913690] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.913690] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.913761] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.913883] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.913934] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa1e565f-d426-4783-ad96-ca42d167f6b8 already deleted. [ 732.913991] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa1e565f-d426-4783-ad96-ca42d167f6b8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.054034] env[65471]: INFO networking_nsxv3.common.synchronization [None req-a1f5b9fe-25ba-4283-a853-05c8b5212361 tempest-AttachInterfacesUnderV243Test-385421637 tempest-AttachInterfacesUnderV243Test-385421637-project-member] Enqueued Resource ID: 927a7ac0-117d-4551-a979-a43f61af6c25 with Priority: HIGHEST for action security_group_rules [ 733.054189] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 927a7ac0-117d-4551-a979-a43f61af6c25 with Priority: HIGHEST for action security_group_rules [ 733.054510] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-927a7ac0-117d-4551-a979-a43f61af6c25 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.054633] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-927a7ac0-117d-4551-a979-a43f61af6c25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.054695] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-927a7ac0-117d-4551-a979-a43f61af6c25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.054981] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-927a7ac0-117d-4551-a979-a43f61af6c25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.055079] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('927a7ac0-117d-4551-a979-a43f61af6c25',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.176869] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('85af6c5e-2f9b-491d-9584-96c44b20f99f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.538869] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a in Status: SUCCESS [ 733.538869] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.538869] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.538869] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.538869] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.538869] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.538869] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.538869] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.538869] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.538869] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.538869] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.587367] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.587542] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.587616] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.587824] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.587923] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.588096] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 927a7ac0-117d-4551-a979-a43f61af6c25 already deleted. [ 733.588145] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-927a7ac0-117d-4551-a979-a43f61af6c25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.616725] env[65471]: INFO networking_nsxv3.common.synchronization [None req-73f87a3b-00c0-401c-b72e-508ff7d62841 tempest-AttachInterfacesUnderV243Test-385421637 tempest-AttachInterfacesUnderV243Test-385421637-project-member] Enqueued Resource ID: 927a7ac0-117d-4551-a979-a43f61af6c25 with Priority: HIGHEST for action security_group_rules [ 733.617327] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 927a7ac0-117d-4551-a979-a43f61af6c25 with Priority: HIGHEST for action security_group_rules [ 733.617643] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-927a7ac0-117d-4551-a979-a43f61af6c25 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.617766] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-927a7ac0-117d-4551-a979-a43f61af6c25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.617835] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-927a7ac0-117d-4551-a979-a43f61af6c25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.618323] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-927a7ac0-117d-4551-a979-a43f61af6c25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.618457] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('927a7ac0-117d-4551-a979-a43f61af6c25',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.681617] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.681774] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.681774] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.681944] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.682049] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.682150] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f is going to be created. [ 733.710722] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.710868] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.710937] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.711227] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.711348] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.725019] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f in Status: UNINITIALIZED for 2s [ 733.792287] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69a8cc18-3d2c-4522-9688-4b5525d659e0 in Status: SUCCESS [ 733.792481] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69a8cc18-3d2c-4522-9688-4b5525d659e0 deletion is rescheduled due to dependency. [ 733.793132] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69a8cc18-3d2c-4522-9688-4b5525d659e0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.041727] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.042638] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.042638] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.042638] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.042638] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.042638] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.042868] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.043114] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.043259] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.044023] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.044422] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.044422] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.044422] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.044873] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.044873] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.045805] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.045950] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.046177] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.046311] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.046545] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.046545] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.139760] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.139956] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.140262] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.140475] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.140564] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.140693] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 927a7ac0-117d-4551-a979-a43f61af6c25 already deleted. [ 734.140808] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-927a7ac0-117d-4551-a979-a43f61af6c25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.487029] env[65471]: INFO networking_nsxv3.common.synchronization [None req-094079b5-1395-4ac6-b7e8-3c1c962812fc None None] Enqueued Resource ID: 3641f5e7-ccd7-4ed9-9f36-d85dd0674775 with Priority: HIGHEST for action port [ 734.487029] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3641f5e7-ccd7-4ed9-9f36-d85dd0674775 with Priority: HIGHEST for action port [ 734.487029] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-3641f5e7-ccd7-4ed9-9f36-d85dd0674775 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.487029] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3641f5e7-ccd7-4ed9-9f36-d85dd0674775" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.487029] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3641f5e7-ccd7-4ed9-9f36-d85dd0674775" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.487465] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3641f5e7-ccd7-4ed9-9f36-d85dd0674775" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.487629] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3641f5e7-ccd7-4ed9-9f36-d85dd0674775',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.552796] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a: rpc.has_security_group_logging(os_id): False [ 734.571235] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.571375] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.571468] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.571697] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.571806] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.572224] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.572338] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.572405] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.572599] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.572683] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.572890] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.572984] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.573080] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.573198] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.573272] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.573488] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.573607] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.573670] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.573808] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.573882] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.573966] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a is going to be created. [ 734.652224] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.654246] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.654246] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.654246] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.654246] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.665862] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a in Status: IN_PROGRESS for 2s [ 734.992705] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3641f5e7-ccd7-4ed9-9f36-d85dd0674775 [ 734.992969] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.993196] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.993307] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.993653] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.993797] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.993964] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3641f5e7-ccd7-4ed9-9f36-d85dd0674775 already deleted. [ 734.994116] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3641f5e7-ccd7-4ed9-9f36-d85dd0674775" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.736650] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f in Status: SUCCESS [ 735.736976] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.736976] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.737461] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.737461] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.737461] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.737461] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.737660] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.737706] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.737778] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.737871] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('85af6c5e-2f9b-491d-9584-96c44b20f99f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.242632] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-85af6c5e-2f9b-491d-9584-96c44b20f99f taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.243335] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.243993] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.243993] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.243993] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.244209] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.244353] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.244564] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.244701] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.244834] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.245122] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-85af6c5e-2f9b-491d-9584-96c44b20f99f taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.245583] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.245712] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.246761] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.246761] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.246761] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.246761] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.246761] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.246761] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.247125] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.247629] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('85af6c5e-2f9b-491d-9584-96c44b20f99f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.688029] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a in Status: SUCCESS [ 736.688029] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.752435] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 85af6c5e-2f9b-491d-9584-96c44b20f99f: rpc.has_security_group_logging(os_id): False [ 736.799223] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.799389] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.799462] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.799678] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.799999] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.802471] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.802471] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.802471] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.802471] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.802471] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.802471] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.802471] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.802471] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.802471] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.802471] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.802471] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.802471] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.802471] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.803035] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.803035] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.803035] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f is going to be created. [ 736.881089] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.881181] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.881227] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.881516] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.881694] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.894171] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f in Status: IN_PROGRESS for 2s [ 738.805551] env[65471]: INFO networking_nsxv3.common.synchronization [req-c0fc4f90-1761-484c-8efc-07635d2e6f74 req-6a63d28c-a499-4179-93d0-fa0ff8ac753c tempest-SecurityGroupsTestJSON-778312627 tempest-SecurityGroupsTestJSON-778312627-project-member] Enqueued Resource ID: ca7195fd-265e-439f-ac03-4bb1a006981b with Priority: HIGHEST for action security_group_members [ 738.805866] env[65471]: INFO networking_nsxv3.common.synchronization [req-c0fc4f90-1761-484c-8efc-07635d2e6f74 req-6a63d28c-a499-4179-93d0-fa0ff8ac753c tempest-SecurityGroupsTestJSON-778312627 tempest-SecurityGroupsTestJSON-778312627-project-member] Enqueued Resource ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 with Priority: HIGHEST for action security_group_members [ 738.806285] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca7195fd-265e-439f-ac03-4bb1a006981b with Priority: HIGHEST for action security_group_members [ 738.806429] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 with Priority: HIGHEST for action security_group_members [ 738.806698] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7195fd-265e-439f-ac03-4bb1a006981b taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.806820] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7195fd-265e-439f-ac03-4bb1a006981b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.806886] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7195fd-265e-439f-ac03-4bb1a006981b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.807375] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7195fd-265e-439f-ac03-4bb1a006981b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.807550] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.807710] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.807710] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.807876] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.807962] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.808070] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca7195fd-265e-439f-ac03-4bb1a006981b',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.808921] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.809052] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.809237] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.809834] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.809998] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.810162] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.810162] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.810394] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.810480] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.810561] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b60bf9ef-6e65-4c6d-87e2-33b6bcafa939',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.857358] env[65471]: INFO networking_nsxv3.common.synchronization [req-c0fc4f90-1761-484c-8efc-07635d2e6f74 req-6a63d28c-a499-4179-93d0-fa0ff8ac753c tempest-SecurityGroupsTestJSON-778312627 tempest-SecurityGroupsTestJSON-778312627-project-member] Enqueued Resource ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 with Priority: HIGHEST for action security_group_rules [ 738.857509] env[65471]: INFO networking_nsxv3.common.synchronization [req-c0fc4f90-1761-484c-8efc-07635d2e6f74 req-6a63d28c-a499-4179-93d0-fa0ff8ac753c tempest-SecurityGroupsTestJSON-778312627 tempest-SecurityGroupsTestJSON-778312627-project-member] Enqueued Resource ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 with Priority: HIGHEST for action security_group_members [ 738.857641] env[65471]: INFO networking_nsxv3.common.synchronization [req-c0fc4f90-1761-484c-8efc-07635d2e6f74 req-6a63d28c-a499-4179-93d0-fa0ff8ac753c tempest-SecurityGroupsTestJSON-778312627 tempest-SecurityGroupsTestJSON-778312627-project-member] Enqueued Resource ID: ca7195fd-265e-439f-ac03-4bb1a006981b with Priority: HIGHEST for action security_group_rules [ 738.858251] env[65471]: INFO networking_nsxv3.common.synchronization [req-c0fc4f90-1761-484c-8efc-07635d2e6f74 req-6a63d28c-a499-4179-93d0-fa0ff8ac753c tempest-SecurityGroupsTestJSON-778312627 tempest-SecurityGroupsTestJSON-778312627-project-member] Enqueued Resource ID: ca7195fd-265e-439f-ac03-4bb1a006981b with Priority: HIGHEST for action security_group_members [ 738.858251] env[65471]: INFO networking_nsxv3.common.synchronization [req-c0fc4f90-1761-484c-8efc-07635d2e6f74 req-6a63d28c-a499-4179-93d0-fa0ff8ac753c tempest-SecurityGroupsTestJSON-778312627 tempest-SecurityGroupsTestJSON-778312627-project-member] Enqueued Resource ID: 8620d30a-1e37-477f-b4de-27e8195fa6e0 with Priority: HIGHEST for action port [ 738.859117] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 with Priority: HIGHEST for action security_group_rules [ 738.859117] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca7195fd-265e-439f-ac03-4bb1a006981b with Priority: HIGHEST for action security_group_rules [ 738.859174] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8620d30a-1e37-477f-b4de-27e8195fa6e0 with Priority: HIGHEST for action port [ 738.859663] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 with Priority: HIGHEST for action security_group_members [ 738.859663] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca7195fd-265e-439f-ac03-4bb1a006981b with Priority: HIGHEST for action security_group_members [ 738.860083] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.860287] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.860393] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.860843] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.860843] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b60bf9ef-6e65-4c6d-87e2-33b6bcafa939',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.862584] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca7195fd-265e-439f-ac03-4bb1a006981b taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.862749] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca7195fd-265e-439f-ac03-4bb1a006981b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.864391] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca7195fd-265e-439f-ac03-4bb1a006981b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.864391] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca7195fd-265e-439f-ac03-4bb1a006981b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.864391] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca7195fd-265e-439f-ac03-4bb1a006981b',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.864391] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-8620d30a-1e37-477f-b4de-27e8195fa6e0 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.864391] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8620d30a-1e37-477f-b4de-27e8195fa6e0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.864391] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8620d30a-1e37-477f-b4de-27e8195fa6e0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.864391] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8620d30a-1e37-477f-b4de-27e8195fa6e0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.865050] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8620d30a-1e37-477f-b4de-27e8195fa6e0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.865841] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.866051] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.866266] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7195fd-265e-439f-ac03-4bb1a006981b taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.866828] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7195fd-265e-439f-ac03-4bb1a006981b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.908456] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f in Status: SUCCESS [ 738.908896] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.313620] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b60bf9ef-6e65-4c6d-87e2-33b6bcafa939',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.314585] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca7195fd-265e-439f-ac03-4bb1a006981b',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.363647] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.363803] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.368384] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8620d30a-1e37-477f-b4de-27e8195fa6e0 with status ACTIVE [ 739.368601] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.368729] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.368794] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.369065] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.369175] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.370281] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.370421] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.370485] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.370661] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.370745] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.370932] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.371179] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.371343] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.371454] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.371530] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.371616] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8620d30a-1e37-477f-b4de-27e8195fa6e0 is going to be updated. [ 739.372787] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7195fd-265e-439f-ac03-4bb1a006981b taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.372899] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7195fd-265e-439f-ac03-4bb1a006981b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.395842] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.397161] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.397267] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.397492] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.397684] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.397866] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8620d30a-1e37-477f-b4de-27e8195fa6e0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.816276] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b60bf9ef-6e65-4c6d-87e2-33b6bcafa939',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.820284] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca7195fd-265e-439f-ac03-4bb1a006981b',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.318518] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.318763] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.318763] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.319102] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.319341] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.319341] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 is going to be updated. [ 740.322887] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.323077] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.323077] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.324273] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.324273] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.324273] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca7195fd-265e-439f-ac03-4bb1a006981b is going to be created. [ 740.361915] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.362133] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.362133] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.362304] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.362452] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.368269] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.368524] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.368524] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.368867] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.369036] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.375787] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7195fd-265e-439f-ac03-4bb1a006981b in Status: UNINITIALIZED for 2s [ 740.376647] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 in Status: IN_PROGRESS for 2s [ 740.380351] env[65471]: INFO networking_nsxv3.common.synchronization [None req-516fdcc8-023f-4b38-b8b1-c84b41779031 None None] Enqueued Resource ID: 0ce24a6e-3e61-418e-ad48-ef59a05e4910 with Priority: HIGHEST for action port [ 740.380608] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ce24a6e-3e61-418e-ad48-ef59a05e4910 with Priority: HIGHEST for action port [ 740.381250] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-0ce24a6e-3e61-418e-ad48-ef59a05e4910 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.381396] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0ce24a6e-3e61-418e-ad48-ef59a05e4910" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.381455] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0ce24a6e-3e61-418e-ad48-ef59a05e4910" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.381675] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0ce24a6e-3e61-418e-ad48-ef59a05e4910" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.381784] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ce24a6e-3e61-418e-ad48-ef59a05e4910',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.885189] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0ce24a6e-3e61-418e-ad48-ef59a05e4910 [ 740.885539] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.885727] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.885825] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.886190] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.886253] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.886375] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0ce24a6e-3e61-418e-ad48-ef59a05e4910 already deleted. [ 740.886498] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0ce24a6e-3e61-418e-ad48-ef59a05e4910" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.389751] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7195fd-265e-439f-ac03-4bb1a006981b in Status: SUCCESS [ 742.389751] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7195fd-265e-439f-ac03-4bb1a006981b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.389751] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7195fd-265e-439f-ac03-4bb1a006981b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.389751] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7195fd-265e-439f-ac03-4bb1a006981b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.389751] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.390201] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.390201] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.390201] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.390201] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.390201] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca7195fd-265e-439f-ac03-4bb1a006981b',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.393434] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 in Status: SUCCESS [ 742.393434] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.393434] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.393434] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.393434] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.393434] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.393434] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.393434] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.393434] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.394144] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b60bf9ef-6e65-4c6d-87e2-33b6bcafa939',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.425462] env[65471]: INFO networking_nsxv3.common.synchronization [None req-07a8fa9c-7a5a-4153-b227-e24c51d02f72 None None] Enqueued Resource ID: 60611ba2-a97f-4d3c-93d4-53ca0cfdf6ff with Priority: HIGHEST for action port [ 742.425462] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60611ba2-a97f-4d3c-93d4-53ca0cfdf6ff with Priority: HIGHEST for action port [ 742.425462] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-60611ba2-a97f-4d3c-93d4-53ca0cfdf6ff taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.425462] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-60611ba2-a97f-4d3c-93d4-53ca0cfdf6ff" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.425794] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-60611ba2-a97f-4d3c-93d4-53ca0cfdf6ff" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.425865] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-60611ba2-a97f-4d3c-93d4-53ca0cfdf6ff" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.425980] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60611ba2-a97f-4d3c-93d4-53ca0cfdf6ff',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.896823] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca7195fd-265e-439f-ac03-4bb1a006981b',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.898223] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b60bf9ef-6e65-4c6d-87e2-33b6bcafa939',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.928636] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 60611ba2-a97f-4d3c-93d4-53ca0cfdf6ff [ 742.928885] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.929031] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.929103] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.929311] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.929403] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.929530] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:60611ba2-a97f-4d3c-93d4-53ca0cfdf6ff already deleted. [ 742.929565] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-60611ba2-a97f-4d3c-93d4-53ca0cfdf6ff" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.171284] env[65471]: INFO networking_nsxv3.common.synchronization [req-9892fa8d-460e-41e3-88c9-870fa96e74d7 req-e7f3390e-87d8-40d6-989b-62d09e933a63 tempest-SecurityGroupsTestJSON-778312627 tempest-SecurityGroupsTestJSON-778312627-project-member] Enqueued Resource ID: ca7195fd-265e-439f-ac03-4bb1a006981b with Priority: HIGHEST for action security_group_members [ 743.171554] env[65471]: INFO networking_nsxv3.common.synchronization [req-9892fa8d-460e-41e3-88c9-870fa96e74d7 req-e7f3390e-87d8-40d6-989b-62d09e933a63 tempest-SecurityGroupsTestJSON-778312627 tempest-SecurityGroupsTestJSON-778312627-project-member] Enqueued Resource ID: 76ee3a37-4552-4528-8f6c-448ca2d9b094 with Priority: HIGHEST for action security_group_members [ 743.171626] env[65471]: INFO networking_nsxv3.common.synchronization [req-9892fa8d-460e-41e3-88c9-870fa96e74d7 req-e7f3390e-87d8-40d6-989b-62d09e933a63 tempest-SecurityGroupsTestJSON-778312627 tempest-SecurityGroupsTestJSON-778312627-project-member] Enqueued Resource ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 with Priority: HIGHEST for action security_group_members [ 743.172145] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca7195fd-265e-439f-ac03-4bb1a006981b with Priority: HIGHEST for action security_group_members [ 743.172319] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76ee3a37-4552-4528-8f6c-448ca2d9b094 with Priority: HIGHEST for action security_group_members [ 743.172660] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 with Priority: HIGHEST for action security_group_members [ 743.172660] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7195fd-265e-439f-ac03-4bb1a006981b taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.172808] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7195fd-265e-439f-ac03-4bb1a006981b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.173491] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-76ee3a37-4552-4528-8f6c-448ca2d9b094 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.173491] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76ee3a37-4552-4528-8f6c-448ca2d9b094" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.173491] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76ee3a37-4552-4528-8f6c-448ca2d9b094" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.173491] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76ee3a37-4552-4528-8f6c-448ca2d9b094" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.173748] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.173748] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.173748] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.173958] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.173958] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.174087] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76ee3a37-4552-4528-8f6c-448ca2d9b094',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.174830] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.174922] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.230159] env[65471]: INFO networking_nsxv3.common.synchronization [req-9892fa8d-460e-41e3-88c9-870fa96e74d7 req-e7f3390e-87d8-40d6-989b-62d09e933a63 tempest-SecurityGroupsTestJSON-778312627 tempest-SecurityGroupsTestJSON-778312627-project-member] Enqueued Resource ID: 76ee3a37-4552-4528-8f6c-448ca2d9b094 with Priority: HIGHEST for action security_group_rules [ 743.230159] env[65471]: INFO networking_nsxv3.common.synchronization [req-9892fa8d-460e-41e3-88c9-870fa96e74d7 req-e7f3390e-87d8-40d6-989b-62d09e933a63 tempest-SecurityGroupsTestJSON-778312627 tempest-SecurityGroupsTestJSON-778312627-project-member] Enqueued Resource ID: 76ee3a37-4552-4528-8f6c-448ca2d9b094 with Priority: HIGHEST for action security_group_members [ 743.230159] env[65471]: INFO networking_nsxv3.common.synchronization [req-9892fa8d-460e-41e3-88c9-870fa96e74d7 req-e7f3390e-87d8-40d6-989b-62d09e933a63 tempest-SecurityGroupsTestJSON-778312627 tempest-SecurityGroupsTestJSON-778312627-project-member] Enqueued Resource ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 with Priority: HIGHEST for action security_group_rules [ 743.230159] env[65471]: INFO networking_nsxv3.common.synchronization [req-9892fa8d-460e-41e3-88c9-870fa96e74d7 req-e7f3390e-87d8-40d6-989b-62d09e933a63 tempest-SecurityGroupsTestJSON-778312627 tempest-SecurityGroupsTestJSON-778312627-project-member] Enqueued Resource ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 with Priority: HIGHEST for action security_group_members [ 743.230159] env[65471]: INFO networking_nsxv3.common.synchronization [req-9892fa8d-460e-41e3-88c9-870fa96e74d7 req-e7f3390e-87d8-40d6-989b-62d09e933a63 tempest-SecurityGroupsTestJSON-778312627 tempest-SecurityGroupsTestJSON-778312627-project-member] Enqueued Resource ID: ca7195fd-265e-439f-ac03-4bb1a006981b with Priority: HIGHEST for action security_group_rules [ 743.230159] env[65471]: INFO networking_nsxv3.common.synchronization [req-9892fa8d-460e-41e3-88c9-870fa96e74d7 req-e7f3390e-87d8-40d6-989b-62d09e933a63 tempest-SecurityGroupsTestJSON-778312627 tempest-SecurityGroupsTestJSON-778312627-project-member] Enqueued Resource ID: ca7195fd-265e-439f-ac03-4bb1a006981b with Priority: HIGHEST for action security_group_members [ 743.230159] env[65471]: INFO networking_nsxv3.common.synchronization [req-9892fa8d-460e-41e3-88c9-870fa96e74d7 req-e7f3390e-87d8-40d6-989b-62d09e933a63 tempest-SecurityGroupsTestJSON-778312627 tempest-SecurityGroupsTestJSON-778312627-project-member] Enqueued Resource ID: 8620d30a-1e37-477f-b4de-27e8195fa6e0 with Priority: HIGHEST for action port [ 743.230159] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76ee3a37-4552-4528-8f6c-448ca2d9b094 with Priority: HIGHEST for action security_group_rules [ 743.230159] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 with Priority: HIGHEST for action security_group_rules [ 743.230593] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca7195fd-265e-439f-ac03-4bb1a006981b with Priority: HIGHEST for action security_group_members [ 743.230806] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8620d30a-1e37-477f-b4de-27e8195fa6e0 with Priority: HIGHEST for action port [ 743.230993] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca7195fd-265e-439f-ac03-4bb1a006981b with Priority: HIGHEST for action security_group_rules [ 743.231187] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76ee3a37-4552-4528-8f6c-448ca2d9b094 with Priority: HIGHEST for action security_group_members [ 743.231395] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 with Priority: HIGHEST for action security_group_members [ 743.231850] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-76ee3a37-4552-4528-8f6c-448ca2d9b094 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.232127] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-76ee3a37-4552-4528-8f6c-448ca2d9b094" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.232685] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-76ee3a37-4552-4528-8f6c-448ca2d9b094" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.233061] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-76ee3a37-4552-4528-8f6c-448ca2d9b094" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.233243] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('76ee3a37-4552-4528-8f6c-448ca2d9b094',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.234348] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.234647] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.234948] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7195fd-265e-439f-ac03-4bb1a006981b taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.235143] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7195fd-265e-439f-ac03-4bb1a006981b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.235405] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-8620d30a-1e37-477f-b4de-27e8195fa6e0 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.236059] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8620d30a-1e37-477f-b4de-27e8195fa6e0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.236217] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8620d30a-1e37-477f-b4de-27e8195fa6e0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.236544] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8620d30a-1e37-477f-b4de-27e8195fa6e0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.236711] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8620d30a-1e37-477f-b4de-27e8195fa6e0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.237876] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca7195fd-265e-439f-ac03-4bb1a006981b taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.238198] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca7195fd-265e-439f-ac03-4bb1a006981b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.238569] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-76ee3a37-4552-4528-8f6c-448ca2d9b094 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.241897] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76ee3a37-4552-4528-8f6c-448ca2d9b094" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.241897] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.241897] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.400054] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b60bf9ef-6e65-4c6d-87e2-33b6bcafa939',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.401197] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca7195fd-265e-439f-ac03-4bb1a006981b',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.680917] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('76ee3a37-4552-4528-8f6c-448ca2d9b094',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.742698] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-76ee3a37-4552-4528-8f6c-448ca2d9b094 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.742938] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76ee3a37-4552-4528-8f6c-448ca2d9b094" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.743275] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8620d30a-1e37-477f-b4de-27e8195fa6e0 with status ACTIVE [ 743.743516] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.743713] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.743843] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.744369] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.744369] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.744567] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.744684] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.744802] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.745099] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.745191] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.745404] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.745700] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.745897] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.746047] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.746130] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.746254] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8620d30a-1e37-477f-b4de-27e8195fa6e0 is going to be updated. [ 743.771495] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.771648] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.771703] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.771917] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.772071] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.772249] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8620d30a-1e37-477f-b4de-27e8195fa6e0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.903729] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.903729] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.903729] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.903729] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.903914] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.903914] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 is going to be updated. [ 743.906026] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.906026] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.906026] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.906026] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.906026] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.906026] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca7195fd-265e-439f-ac03-4bb1a006981b is going to be updated. [ 743.948742] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.948742] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.949058] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.949058] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.949183] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.952347] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.952822] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.953088] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.953528] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.953855] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.969610] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 in Status: IN_PROGRESS for 2s [ 743.969610] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7195fd-265e-439f-ac03-4bb1a006981b in Status: IN_PROGRESS for 2s [ 744.183665] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('76ee3a37-4552-4528-8f6c-448ca2d9b094',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.688486] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.688753] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.688753] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.688856] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.688915] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.689014] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76ee3a37-4552-4528-8f6c-448ca2d9b094 is going to be created. [ 744.718908] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.719204] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.719204] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.719414] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.719984] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.731165] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76ee3a37-4552-4528-8f6c-448ca2d9b094 in Status: UNINITIALIZED for 2s [ 745.981952] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 in Status: SUCCESS [ 745.982412] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.982412] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.982630] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.982869] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.983228] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.983295] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.983640] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.983720] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.984034] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.984137] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b60bf9ef-6e65-4c6d-87e2-33b6bcafa939',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.986809] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7195fd-265e-439f-ac03-4bb1a006981b in Status: SUCCESS [ 745.986901] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7195fd-265e-439f-ac03-4bb1a006981b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.989857] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.989857] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.989857] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.990196] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.990355] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.990550] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.990806] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.990806] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b60bf9ef-6e65-4c6d-87e2-33b6bcafa939',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.992039] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7195fd-265e-439f-ac03-4bb1a006981b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.992557] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7195fd-265e-439f-ac03-4bb1a006981b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.992782] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.993808] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.993808] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.993888] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.994909] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.995021] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7195fd-265e-439f-ac03-4bb1a006981b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.995127] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ca7195fd-265e-439f-ac03-4bb1a006981b',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.999623] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7195fd-265e-439f-ac03-4bb1a006981b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.999853] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7195fd-265e-439f-ac03-4bb1a006981b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.000188] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.000365] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.000436] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.000851] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.000937] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.001131] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca7195fd-265e-439f-ac03-4bb1a006981b',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.497796] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.497928] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.503353] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca7195fd-265e-439f-ac03-4bb1a006981b',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.504519] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ca7195fd-265e-439f-ac03-4bb1a006981b',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.505932] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b60bf9ef-6e65-4c6d-87e2-33b6bcafa939',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.746839] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76ee3a37-4552-4528-8f6c-448ca2d9b094 in Status: SUCCESS [ 746.746993] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76ee3a37-4552-4528-8f6c-448ca2d9b094" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.747364] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76ee3a37-4552-4528-8f6c-448ca2d9b094" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.747461] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76ee3a37-4552-4528-8f6c-448ca2d9b094" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.747681] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.747813] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.747880] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.748056] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.748142] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.748271] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76ee3a37-4552-4528-8f6c-448ca2d9b094',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.006859] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ca7195fd-265e-439f-ac03-4bb1a006981b: rpc.has_security_group_logging(os_id): False [ 747.008431] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca7195fd-265e-439f-ac03-4bb1a006981b',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.009398] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b60bf9ef-6e65-4c6d-87e2-33b6bcafa939',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.033138] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.033329] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.033371] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.033586] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.033685] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.033955] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.034083] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.034083] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.034320] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.034320] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.034498] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca7195fd-265e-439f-ac03-4bb1a006981b is going to be created. [ 747.107211] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.107437] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.107544] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.107863] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.108242] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.129550] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca7195fd-265e-439f-ac03-4bb1a006981b in Status: IN_PROGRESS for 2s [ 747.253577] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('76ee3a37-4552-4528-8f6c-448ca2d9b094',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.514173] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.514173] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.514173] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.514173] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.514173] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.514173] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 is going to be updated. [ 747.514173] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.514173] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.514925] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.514925] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.514925] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.514925] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca7195fd-265e-439f-ac03-4bb1a006981b is going to be updated. [ 747.572499] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.572499] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.572499] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.572753] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.572878] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.574546] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.574710] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.574710] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.574829] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.574893] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.587189] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 in Status: IN_PROGRESS for 2s [ 747.588028] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7195fd-265e-439f-ac03-4bb1a006981b in Status: IN_PROGRESS for 2s [ 747.728976] env[65471]: INFO networking_nsxv3.common.synchronization [req-9f9063f3-f028-4442-8338-18899012505b req-ebfc2546-b6cc-4931-ac03-219e086cf02d tempest-FloatingIPsAssociationTestJSON-777761534 tempest-FloatingIPsAssociationTestJSON-777761534-project-member] Enqueued Resource ID: fc157df5-294c-4a29-82ae-e1ec842611f3 with Priority: HIGHEST for action security_group_members [ 747.732153] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc157df5-294c-4a29-82ae-e1ec842611f3 with Priority: HIGHEST for action security_group_members [ 747.732153] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc157df5-294c-4a29-82ae-e1ec842611f3 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.732153] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc157df5-294c-4a29-82ae-e1ec842611f3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.732153] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc157df5-294c-4a29-82ae-e1ec842611f3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.732153] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc157df5-294c-4a29-82ae-e1ec842611f3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.732153] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.732153] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.732153] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.732153] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.732153] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.732153] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc157df5-294c-4a29-82ae-e1ec842611f3',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.761061] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('76ee3a37-4552-4528-8f6c-448ca2d9b094',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.237220] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fc157df5-294c-4a29-82ae-e1ec842611f3',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.263818] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.263818] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.263818] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.263964] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.263964] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.264066] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76ee3a37-4552-4528-8f6c-448ca2d9b094 is going to be updated. [ 748.326107] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.326276] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.326341] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.326531] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.326882] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.336586] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76ee3a37-4552-4528-8f6c-448ca2d9b094 in Status: IN_PROGRESS for 2s [ 748.739955] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fc157df5-294c-4a29-82ae-e1ec842611f3',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.990121] env[65471]: INFO networking_nsxv3.common.synchronization [req-6cb10c38-c560-4d5f-b6f2-da30fdd8ef98 req-68df12eb-8476-4e5a-9f92-dbb98cd33cb4 tempest-ServersV294TestFqdnHostnames-74272933 tempest-ServersV294TestFqdnHostnames-74272933-project-member] Enqueued Resource ID: aa1e565f-d426-4783-ad96-ca42d167f6b8 with Priority: HIGHEST for action security_group_members [ 748.990774] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa1e565f-d426-4783-ad96-ca42d167f6b8 with Priority: HIGHEST for action security_group_members [ 748.991091] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa1e565f-d426-4783-ad96-ca42d167f6b8 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.991206] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa1e565f-d426-4783-ad96-ca42d167f6b8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.991274] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa1e565f-d426-4783-ad96-ca42d167f6b8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.992156] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa1e565f-d426-4783-ad96-ca42d167f6b8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.992156] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.992156] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.992156] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.992156] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.992156] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.992492] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa1e565f-d426-4783-ad96-ca42d167f6b8',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.146087] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca7195fd-265e-439f-ac03-4bb1a006981b in Status: SUCCESS [ 749.146320] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca7195fd-265e-439f-ac03-4bb1a006981b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.146529] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca7195fd-265e-439f-ac03-4bb1a006981b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.146745] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca7195fd-265e-439f-ac03-4bb1a006981b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.147527] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca7195fd-265e-439f-ac03-4bb1a006981b',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.244490] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.244801] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.244801] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.244933] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.245092] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.245190] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc157df5-294c-4a29-82ae-e1ec842611f3 is going to be updated. [ 749.277172] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.277331] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.277383] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.277663] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.277738] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.288820] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc157df5-294c-4a29-82ae-e1ec842611f3 in Status: IN_PROGRESS for 2s [ 749.422209] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock network-605 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.422209] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "network-605" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.422209] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "network-605" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.422209] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "network-605" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.422209] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.422209] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.422209] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.422209] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.422209] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.422209] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 749.422744] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 749.422985] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 749.423226] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 749.423513] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 749.423739] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 749.423964] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 749.448293] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 749.448484] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 749.448619] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 749.448788] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "network-605" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.449113] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock port-bff49919-cf4b-4ded-be78-1d848e14f932 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.449270] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "port-bff49919-cf4b-4ded-be78-1d848e14f932" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.449387] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "port-bff49919-cf4b-4ded-be78-1d848e14f932" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.449716] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "port-bff49919-cf4b-4ded-be78-1d848e14f932" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.449848] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bff49919-cf4b-4ded-be78-1d848e14f932',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.494076] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.494238] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.494309] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.494682] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.494792] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.495037] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.495140] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.495204] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.495376] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.495504] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.495551] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa1e565f-d426-4783-ad96-ca42d167f6b8 already deleted. [ 749.495622] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa1e565f-d426-4783-ad96-ca42d167f6b8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.601744] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7195fd-265e-439f-ac03-4bb1a006981b in Status: SUCCESS [ 749.601993] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7195fd-265e-439f-ac03-4bb1a006981b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.602689] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7195fd-265e-439f-ac03-4bb1a006981b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.603178] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7195fd-265e-439f-ac03-4bb1a006981b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.603461] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.603647] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.603747] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.604287] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.604287] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.604555] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca7195fd-265e-439f-ac03-4bb1a006981b',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.606755] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 in Status: SUCCESS [ 749.607852] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.608063] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.608397] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.608742] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.608991] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.609277] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.609694] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.609820] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.610038] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b60bf9ef-6e65-4c6d-87e2-33b6bcafa939',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.649019] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7195fd-265e-439f-ac03-4bb1a006981b taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.649193] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7195fd-265e-439f-ac03-4bb1a006981b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.652276] env[65471]: INFO networking_nsxv3.common.synchronization [req-240fbde2-68c1-41b7-ad7e-9ca2ad5f354c req-c222ecc0-746d-4774-a998-5806f2fa37fe tempest-ServerPasswordTestJSON-1888175839 tempest-ServerPasswordTestJSON-1888175839-project-member] Enqueued Resource ID: ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a with Priority: HIGHEST for action security_group_members [ 749.652983] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a with Priority: HIGHEST for action security_group_members [ 749.653422] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.653651] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.653779] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.654028] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.654246] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.654399] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.654500] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.654712] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.654838] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.654975] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.954852] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.955154] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.955329] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.955522] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.955677] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.955842] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Segment Port bff49919-cf4b-4ded-be78-1d848e14f932 not found, creating... [ 749.956097] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.956269] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.956375] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.956592] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.956742] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.957037] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.957195] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.957299] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.957503] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.957635] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.957768] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Resource: SegmentPort with ID: bff49919-cf4b-4ded-be78-1d848e14f932 is going to be created. [ 749.979443] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.979722] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.979811] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.980027] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.980285] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.980568] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "port-bff49919-cf4b-4ded-be78-1d848e14f932" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.113048] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca7195fd-265e-439f-ac03-4bb1a006981b',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.113048] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b60bf9ef-6e65-4c6d-87e2-33b6bcafa939',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.157279] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.157549] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.157658] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.157980] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.158148] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.158605] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.158724] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.158794] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.158971] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.159088] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.159203] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a is going to be updated. [ 750.188859] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.189069] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.189069] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.189218] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.189362] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.200872] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a in Status: IN_PROGRESS for 2s [ 750.346890] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76ee3a37-4552-4528-8f6c-448ca2d9b094 in Status: SUCCESS [ 750.347239] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76ee3a37-4552-4528-8f6c-448ca2d9b094" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.347307] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76ee3a37-4552-4528-8f6c-448ca2d9b094" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.347665] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76ee3a37-4552-4528-8f6c-448ca2d9b094" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.347891] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.348016] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.348089] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.348323] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.348416] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.348543] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76ee3a37-4552-4528-8f6c-448ca2d9b094" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.348642] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('76ee3a37-4552-4528-8f6c-448ca2d9b094',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.615097] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca7195fd-265e-439f-ac03-4bb1a006981b',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.617339] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b60bf9ef-6e65-4c6d-87e2-33b6bcafa939',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.790241] env[65471]: INFO networking_nsxv3.common.synchronization [req-6cb10c38-c560-4d5f-b6f2-da30fdd8ef98 req-8ebbc419-4af1-4d05-9d47-3755c47cf55d service nova] Enqueued Resource ID: aa1e565f-d426-4783-ad96-ca42d167f6b8 with Priority: HIGHEST for action security_group_rules [ 750.790520] env[65471]: INFO networking_nsxv3.common.synchronization [req-6cb10c38-c560-4d5f-b6f2-da30fdd8ef98 req-8ebbc419-4af1-4d05-9d47-3755c47cf55d service nova] Enqueued Resource ID: aa1e565f-d426-4783-ad96-ca42d167f6b8 with Priority: HIGHEST for action security_group_members [ 750.790787] env[65471]: INFO networking_nsxv3.common.synchronization [req-6cb10c38-c560-4d5f-b6f2-da30fdd8ef98 req-8ebbc419-4af1-4d05-9d47-3755c47cf55d service nova] Enqueued Resource ID: bff49919-cf4b-4ded-be78-1d848e14f932 with Priority: HIGHEST for action port [ 750.792044] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa1e565f-d426-4783-ad96-ca42d167f6b8 with Priority: HIGHEST for action security_group_rules [ 750.792191] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa1e565f-d426-4783-ad96-ca42d167f6b8 with Priority: HIGHEST for action security_group_members [ 750.792295] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bff49919-cf4b-4ded-be78-1d848e14f932 with Priority: HIGHEST for action port [ 750.792565] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa1e565f-d426-4783-ad96-ca42d167f6b8 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.792696] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa1e565f-d426-4783-ad96-ca42d167f6b8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.792773] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa1e565f-d426-4783-ad96-ca42d167f6b8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.792961] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa1e565f-d426-4783-ad96-ca42d167f6b8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.793052] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa1e565f-d426-4783-ad96-ca42d167f6b8',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.793945] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa1e565f-d426-4783-ad96-ca42d167f6b8 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.794078] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa1e565f-d426-4783-ad96-ca42d167f6b8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.794145] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa1e565f-d426-4783-ad96-ca42d167f6b8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.794306] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa1e565f-d426-4783-ad96-ca42d167f6b8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.794448] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.794539] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.794598] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.794731] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.794840] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.794970] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa1e565f-d426-4783-ad96-ca42d167f6b8',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.798355] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-bff49919-cf4b-4ded-be78-1d848e14f932 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.798355] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bff49919-cf4b-4ded-be78-1d848e14f932" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.798355] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bff49919-cf4b-4ded-be78-1d848e14f932" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.798355] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bff49919-cf4b-4ded-be78-1d848e14f932" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.798570] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bff49919-cf4b-4ded-be78-1d848e14f932',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.852124] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('76ee3a37-4552-4528-8f6c-448ca2d9b094',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.120723] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.121178] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.121178] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.121540] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.121609] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.121682] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 is going to be updated. [ 751.123010] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.123626] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.123937] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.125309] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.125386] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.125453] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca7195fd-265e-439f-ac03-4bb1a006981b is going to be updated. [ 751.175418] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.175418] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.175418] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.175418] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.175671] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.177940] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.178093] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.178169] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.178660] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.178816] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.189583] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7195fd-265e-439f-ac03-4bb1a006981b in Status: IN_PROGRESS for 2s [ 751.190292] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 in Status: IN_PROGRESS for 2s [ 751.300833] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa1e565f-d426-4783-ad96-ca42d167f6b8 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.300972] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa1e565f-d426-4783-ad96-ca42d167f6b8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.301264] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa1e565f-d426-4783-ad96-ca42d167f6b8',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.302170] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bff49919-cf4b-4ded-be78-1d848e14f932 with status ACTIVE [ 751.305408] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.305408] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.305408] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.305408] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.305408] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.305408] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.305408] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.305408] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.305408] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.305408] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.305408] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.305408] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.305408] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.305408] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.305408] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.305408] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bff49919-cf4b-4ded-be78-1d848e14f932 is going to be updated. [ 751.312571] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc157df5-294c-4a29-82ae-e1ec842611f3 in Status: SUCCESS [ 751.313818] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc157df5-294c-4a29-82ae-e1ec842611f3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.356615] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 76ee3a37-4552-4528-8f6c-448ca2d9b094: rpc.has_security_group_logging(os_id): False [ 751.368852] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.369048] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.369110] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.369301] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.369439] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.369612] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bff49919-cf4b-4ded-be78-1d848e14f932" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.380878] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.381040] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.381040] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.381358] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.381498] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.381830] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.382053] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.382053] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.382396] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.383039] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.383039] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 76ee3a37-4552-4528-8f6c-448ca2d9b094 is going to be created. [ 751.463866] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.464061] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.464150] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.464365] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.464552] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.479018] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 76ee3a37-4552-4528-8f6c-448ca2d9b094 in Status: IN_PROGRESS for 2s [ 751.496269] env[65471]: INFO networking_nsxv3.common.synchronization [None req-663b953c-cdfd-4cc5-a298-532d747c1c54 None None] Enqueued Resource ID: 192cf2f5-de70-4b1a-b0e4-0ef4033ba3c8 with Priority: HIGHEST for action port [ 751.497024] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 192cf2f5-de70-4b1a-b0e4-0ef4033ba3c8 with Priority: HIGHEST for action port [ 751.497638] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-192cf2f5-de70-4b1a-b0e4-0ef4033ba3c8 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.497842] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-192cf2f5-de70-4b1a-b0e4-0ef4033ba3c8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.497910] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-192cf2f5-de70-4b1a-b0e4-0ef4033ba3c8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.498190] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-192cf2f5-de70-4b1a-b0e4-0ef4033ba3c8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.498284] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('192cf2f5-de70-4b1a-b0e4-0ef4033ba3c8',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.814794] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa1e565f-d426-4783-ad96-ca42d167f6b8',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.877925] env[65471]: INFO networking_nsxv3.common.synchronization [req-9dcf34ec-bec2-446b-a925-0df3d7566ab2 req-f6b98f46-2c06-4b54-8cf1-71025ee1fe8a tempest-AttachInterfacesUnderV243Test-385421637 tempest-AttachInterfacesUnderV243Test-385421637-project-member] Enqueued Resource ID: 927a7ac0-117d-4551-a979-a43f61af6c25 with Priority: HIGHEST for action security_group_members [ 751.878585] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 927a7ac0-117d-4551-a979-a43f61af6c25 with Priority: HIGHEST for action security_group_members [ 751.878915] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-927a7ac0-117d-4551-a979-a43f61af6c25 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.879134] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-927a7ac0-117d-4551-a979-a43f61af6c25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.879309] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-927a7ac0-117d-4551-a979-a43f61af6c25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.879793] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-927a7ac0-117d-4551-a979-a43f61af6c25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.879863] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.879918] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.880370] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.880370] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.880535] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.884144] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('927a7ac0-117d-4551-a979-a43f61af6c25',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.002739] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 192cf2f5-de70-4b1a-b0e4-0ef4033ba3c8 [ 752.003082] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.003304] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.003422] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.003790] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.003935] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.004152] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:192cf2f5-de70-4b1a-b0e4-0ef4033ba3c8 already deleted. [ 752.004257] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-192cf2f5-de70-4b1a-b0e4-0ef4033ba3c8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.212466] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a in Status: SUCCESS [ 752.212690] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a deletion is rescheduled due to dependency. [ 752.212806] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.318269] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.318633] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.318633] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.318895] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.319061] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.319199] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa1e565f-d426-4783-ad96-ca42d167f6b8 is going to be created. [ 752.357271] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock network-868 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.357576] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "network-868" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.357576] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "network-868" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.358908] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "network-868" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.358908] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.358908] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.358908] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.358908] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.358908] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.359205] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 752.359316] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 752.359482] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 752.359594] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 752.359756] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 752.360647] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 752.360647] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 752.363079] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.363422] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.364939] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.364939] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.364939] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.376929] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa1e565f-d426-4783-ad96-ca42d167f6b8 in Status: UNINITIALIZED for 2s [ 752.386537] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 752.386698] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 752.386831] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 752.387024] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "network-868" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.387359] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock port-b7f7d722-3ab2-46c4-9816-de31c8439ed6 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.388939] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "port-b7f7d722-3ab2-46c4-9816-de31c8439ed6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.388939] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "port-b7f7d722-3ab2-46c4-9816-de31c8439ed6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.388939] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "port-b7f7d722-3ab2-46c4-9816-de31c8439ed6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.388939] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7f7d722-3ab2-46c4-9816-de31c8439ed6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.389442] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.389684] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.389684] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.389943] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.389943] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.390439] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.390439] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.390439] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.390670] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.390720] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.390827] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 927a7ac0-117d-4551-a979-a43f61af6c25 already deleted. [ 752.391402] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-927a7ac0-117d-4551-a979-a43f61af6c25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.894669] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.894669] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.894891] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.895016] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.895187] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.898384] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Segment Port b7f7d722-3ab2-46c4-9816-de31c8439ed6 not found, creating... [ 752.898384] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.898384] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.898384] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.898384] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.898384] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.898384] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.898384] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.898384] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.898384] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.898906] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.898906] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Resource: SegmentPort with ID: b7f7d722-3ab2-46c4-9816-de31c8439ed6 is going to be created. [ 752.925984] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.925984] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.925984] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.925984] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.926257] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.926480] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "port-b7f7d722-3ab2-46c4-9816-de31c8439ed6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.202210] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 in Status: SUCCESS [ 753.202439] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.203371] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7195fd-265e-439f-ac03-4bb1a006981b in Status: SUCCESS [ 753.203527] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7195fd-265e-439f-ac03-4bb1a006981b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.203690] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.203903] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.204106] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.204219] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.204285] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.204470] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.204556] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.204641] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.204802] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.204898] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.204958] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.205116] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.205258] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.205348] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.205401] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.205568] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.205642] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.205720] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.205831] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b60bf9ef-6e65-4c6d-87e2-33b6bcafa939',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.206647] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7195fd-265e-439f-ac03-4bb1a006981b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.206795] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7195fd-265e-439f-ac03-4bb1a006981b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.206937] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.207077] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.207139] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.207236] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.207309] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.207387] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7195fd-265e-439f-ac03-4bb1a006981b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.207475] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ca7195fd-265e-439f-ac03-4bb1a006981b',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.502273] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 76ee3a37-4552-4528-8f6c-448ca2d9b094 in Status: SUCCESS [ 753.502560] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-76ee3a37-4552-4528-8f6c-448ca2d9b094" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.686615] env[65471]: INFO networking_nsxv3.common.synchronization [req-9dcf34ec-bec2-446b-a925-0df3d7566ab2 req-fb71ace4-2e1f-41ae-bbbb-1ab8492cdc18 service nova] Enqueued Resource ID: 927a7ac0-117d-4551-a979-a43f61af6c25 with Priority: HIGHEST for action security_group_rules [ 753.686701] env[65471]: INFO networking_nsxv3.common.synchronization [req-9dcf34ec-bec2-446b-a925-0df3d7566ab2 req-fb71ace4-2e1f-41ae-bbbb-1ab8492cdc18 service nova] Enqueued Resource ID: 927a7ac0-117d-4551-a979-a43f61af6c25 with Priority: HIGHEST for action security_group_members [ 753.687144] env[65471]: INFO networking_nsxv3.common.synchronization [req-9dcf34ec-bec2-446b-a925-0df3d7566ab2 req-fb71ace4-2e1f-41ae-bbbb-1ab8492cdc18 service nova] Enqueued Resource ID: b7f7d722-3ab2-46c4-9816-de31c8439ed6 with Priority: HIGHEST for action port [ 753.687923] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 927a7ac0-117d-4551-a979-a43f61af6c25 with Priority: HIGHEST for action security_group_rules [ 753.687923] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 927a7ac0-117d-4551-a979-a43f61af6c25 with Priority: HIGHEST for action security_group_members [ 753.687923] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7f7d722-3ab2-46c4-9816-de31c8439ed6 with Priority: HIGHEST for action port [ 753.688188] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-927a7ac0-117d-4551-a979-a43f61af6c25 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.688188] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-927a7ac0-117d-4551-a979-a43f61af6c25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.688313] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-927a7ac0-117d-4551-a979-a43f61af6c25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.688482] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-927a7ac0-117d-4551-a979-a43f61af6c25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.688544] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('927a7ac0-117d-4551-a979-a43f61af6c25',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.691105] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-927a7ac0-117d-4551-a979-a43f61af6c25 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.691232] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-927a7ac0-117d-4551-a979-a43f61af6c25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.691504] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-927a7ac0-117d-4551-a979-a43f61af6c25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.691504] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-927a7ac0-117d-4551-a979-a43f61af6c25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.691762] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.691762] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.692051] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.692051] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.692051] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.692255] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('927a7ac0-117d-4551-a979-a43f61af6c25',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.692995] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-b7f7d722-3ab2-46c4-9816-de31c8439ed6 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.693195] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b7f7d722-3ab2-46c4-9816-de31c8439ed6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.693259] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b7f7d722-3ab2-46c4-9816-de31c8439ed6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.693592] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b7f7d722-3ab2-46c4-9816-de31c8439ed6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.693592] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7f7d722-3ab2-46c4-9816-de31c8439ed6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.710469] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ca7195fd-265e-439f-ac03-4bb1a006981b',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.712381] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b60bf9ef-6e65-4c6d-87e2-33b6bcafa939: rpc.has_security_group_logging(os_id): False [ 753.735154] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.735322] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.735395] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.735619] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.735720] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.735942] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.736059] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.736129] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.736283] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.736360] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.736547] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.736640] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.736704] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.736829] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.736903] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.737555] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.737555] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.737555] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.737780] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.737780] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.737852] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 is going to be updated. [ 753.803497] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.803678] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.803730] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.803918] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.804087] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.818493] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 in Status: IN_PROGRESS for 2s [ 754.138777] env[65471]: INFO networking_nsxv3.common.synchronization [None req-4bde5424-1974-4674-8d50-84a6ed8653ad None None] Enqueued Resource ID: 15877a6e-ac1c-42bf-b748-efeaf54c0b88 with Priority: HIGHEST for action port [ 754.138777] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15877a6e-ac1c-42bf-b748-efeaf54c0b88 with Priority: HIGHEST for action port [ 754.138777] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-15877a6e-ac1c-42bf-b748-efeaf54c0b88 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.139970] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-15877a6e-ac1c-42bf-b748-efeaf54c0b88" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.140223] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-15877a6e-ac1c-42bf-b748-efeaf54c0b88" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.140838] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-15877a6e-ac1c-42bf-b748-efeaf54c0b88" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.141444] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15877a6e-ac1c-42bf-b748-efeaf54c0b88',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.195292] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('927a7ac0-117d-4551-a979-a43f61af6c25',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.196222] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-927a7ac0-117d-4551-a979-a43f61af6c25 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.196397] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-927a7ac0-117d-4551-a979-a43f61af6c25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.196596] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b7f7d722-3ab2-46c4-9816-de31c8439ed6 with status ACTIVE [ 754.196802] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.196925] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.197098] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.197292] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.197383] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.197606] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.197713] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.197787] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.198026] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.198156] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.198430] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.199412] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.199412] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.199412] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.199560] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.199677] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b7f7d722-3ab2-46c4-9816-de31c8439ed6 is going to be updated. [ 754.216054] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ca7195fd-265e-439f-ac03-4bb1a006981b: rpc.has_security_group_logging(os_id): False [ 754.229296] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.229521] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.229631] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.230461] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.230461] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.230461] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b7f7d722-3ab2-46c4-9816-de31c8439ed6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.241375] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.241375] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.241375] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.241375] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.241375] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.241714] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.241834] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.241923] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.242324] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.242324] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.242324] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca7195fd-265e-439f-ac03-4bb1a006981b is going to be updated. [ 754.326023] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.326236] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.326279] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.326505] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.326653] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.350025] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca7195fd-265e-439f-ac03-4bb1a006981b in Status: IN_PROGRESS for 2s [ 754.387185] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa1e565f-d426-4783-ad96-ca42d167f6b8 in Status: SUCCESS [ 754.387419] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa1e565f-d426-4783-ad96-ca42d167f6b8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.387607] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa1e565f-d426-4783-ad96-ca42d167f6b8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.387917] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa1e565f-d426-4783-ad96-ca42d167f6b8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.388056] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.388175] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.388248] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.388436] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.388531] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.388620] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa1e565f-d426-4783-ad96-ca42d167f6b8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.388710] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aa1e565f-d426-4783-ad96-ca42d167f6b8',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.625805] env[65471]: INFO networking_nsxv3.common.synchronization [req-cb87e2de-6be4-409a-ba97-9c390dccf3c2 req-ebc1834a-0512-4a37-b5e1-dfa740ca22ea tempest-ServersTestBootFromVolume-1192670064 tempest-ServersTestBootFromVolume-1192670064-project-member] Enqueued Resource ID: 58316ca3-525d-4197-969c-1e363b6969c6 with Priority: HIGHEST for action security_group_members [ 754.626983] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58316ca3-525d-4197-969c-1e363b6969c6 with Priority: HIGHEST for action security_group_members [ 754.627459] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-58316ca3-525d-4197-969c-1e363b6969c6 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.627627] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58316ca3-525d-4197-969c-1e363b6969c6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.627811] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58316ca3-525d-4197-969c-1e363b6969c6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.628100] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58316ca3-525d-4197-969c-1e363b6969c6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.628362] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.628514] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.628625] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.628888] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.629042] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.629200] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58316ca3-525d-4197-969c-1e363b6969c6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.647154] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 15877a6e-ac1c-42bf-b748-efeaf54c0b88 [ 754.647154] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.647154] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.647154] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.647154] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.647154] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.647154] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:15877a6e-ac1c-42bf-b748-efeaf54c0b88 already deleted. [ 754.647154] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-15877a6e-ac1c-42bf-b748-efeaf54c0b88" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.702314] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('927a7ac0-117d-4551-a979-a43f61af6c25',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.891380] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aa1e565f-d426-4783-ad96-ca42d167f6b8',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.131086] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock network-463 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.131285] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "network-463" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.131355] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "network-463" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.131713] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "network-463" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.131999] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.132193] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.132395] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.132646] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.132811] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.133041] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 755.133151] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 755.133271] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 755.133351] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 755.133454] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 755.133551] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 755.133688] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 755.137022] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.137022] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.137022] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.137022] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.137022] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.137022] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.137022] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.137022] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.137022] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.137022] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.137022] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58316ca3-525d-4197-969c-1e363b6969c6 already deleted. [ 755.137022] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58316ca3-525d-4197-969c-1e363b6969c6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.158260] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 755.160336] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 755.160336] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 755.160336] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "network-463" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.160336] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock port-5480bbba-c78e-4839-8b02-733211bab8b3 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.160336] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "port-5480bbba-c78e-4839-8b02-733211bab8b3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.161370] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "port-5480bbba-c78e-4839-8b02-733211bab8b3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.161370] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "port-5480bbba-c78e-4839-8b02-733211bab8b3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.161461] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5480bbba-c78e-4839-8b02-733211bab8b3',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.204682] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.204920] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.204985] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.205210] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.205301] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.205364] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 927a7ac0-117d-4551-a979-a43f61af6c25 is going to be created. [ 755.237097] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.237318] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.237401] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.237687] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.237863] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.252059] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 927a7ac0-117d-4551-a979-a43f61af6c25 in Status: UNINITIALIZED for 2s [ 755.394172] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aa1e565f-d426-4783-ad96-ca42d167f6b8: rpc.has_security_group_logging(os_id): False [ 755.427407] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.427686] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.427816] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.428115] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.428278] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.428628] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.428810] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.429151] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.429460] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.429585] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.429766] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa1e565f-d426-4783-ad96-ca42d167f6b8 is going to be created. [ 755.518196] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.518367] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.518460] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.518683] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.518885] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.531456] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa1e565f-d426-4783-ad96-ca42d167f6b8 in Status: IN_PROGRESS for 2s [ 755.622909] env[65471]: INFO networking_nsxv3.common.synchronization [req-c48c5683-0b56-4146-a197-9127a257bec5 req-6b189fdb-d6b8-4c95-a279-dbe287fe5a45 tempest-ServersAdminNegativeTestJSON-7494399 tempest-ServersAdminNegativeTestJSON-7494399-project-member] Enqueued Resource ID: 14a38584-d8ef-4361-b344-b91e376144fa with Priority: HIGHEST for action security_group_members [ 755.624384] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14a38584-d8ef-4361-b344-b91e376144fa with Priority: HIGHEST for action security_group_members [ 755.624789] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-14a38584-d8ef-4361-b344-b91e376144fa taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.625926] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14a38584-d8ef-4361-b344-b91e376144fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.626237] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14a38584-d8ef-4361-b344-b91e376144fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.626473] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14a38584-d8ef-4361-b344-b91e376144fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.626703] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.626861] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.626972] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.627217] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.627337] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.627461] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14a38584-d8ef-4361-b344-b91e376144fa',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.665732] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.666074] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.666074] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.666492] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.666605] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.666752] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Segment Port 5480bbba-c78e-4839-8b02-733211bab8b3 not found, creating... [ 755.667076] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.667248] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.667361] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.667785] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.667881] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.668145] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.668335] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.668459] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.668679] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.668999] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.668999] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Resource: SegmentPort with ID: 5480bbba-c78e-4839-8b02-733211bab8b3 is going to be created. [ 755.696542] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.696542] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.696542] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.696822] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.697062] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.697297] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "port-5480bbba-c78e-4839-8b02-733211bab8b3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.824073] env[65471]: INFO networking_nsxv3.common.synchronization [req-5efb5e19-56cc-4fc1-bafd-b7f6b06a2ddf req-8cd1f21d-08f2-4064-8b7a-8b68b7b21dcb tempest-ServerMetadataTestJSON-51384864 tempest-ServerMetadataTestJSON-51384864-project-member] Enqueued Resource ID: 2a9f3871-1bad-4130-b669-97b85ced692d with Priority: HIGHEST for action security_group_members [ 755.824903] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a9f3871-1bad-4130-b669-97b85ced692d with Priority: HIGHEST for action security_group_members [ 755.829021] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a9f3871-1bad-4130-b669-97b85ced692d taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.829021] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a9f3871-1bad-4130-b669-97b85ced692d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.829021] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a9f3871-1bad-4130-b669-97b85ced692d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.829021] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a9f3871-1bad-4130-b669-97b85ced692d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.829021] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.829021] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.829021] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.829021] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.829021] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.829021] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a9f3871-1bad-4130-b669-97b85ced692d',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.838987] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 in Status: SUCCESS [ 755.839517] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.839739] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.840049] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.840169] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b60bf9ef-6e65-4c6d-87e2-33b6bcafa939',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.130820] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('14a38584-d8ef-4361-b344-b91e376144fa',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.329690] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.329828] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.329911] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.330326] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.343595] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.343844] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.343914] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.344158] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.344343] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.344446] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.344510] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.344661] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.344747] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.344833] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.344924] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b60bf9ef-6e65-4c6d-87e2-33b6bcafa939',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.361203] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.361203] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.361203] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.361203] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.361203] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.361203] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.361203] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a9f3871-1bad-4130-b669-97b85ced692d is going to be updated. [ 756.369251] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca7195fd-265e-439f-ac03-4bb1a006981b in Status: SUCCESS [ 756.370244] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca7195fd-265e-439f-ac03-4bb1a006981b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.405961] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.406166] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.406166] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.406339] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.406633] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.417687] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a9f3871-1bad-4130-b669-97b85ced692d in Status: IN_PROGRESS for 2s [ 756.475384] env[65471]: INFO networking_nsxv3.common.synchronization [req-cb87e2de-6be4-409a-ba97-9c390dccf3c2 req-a2e356cb-1c6f-4c94-81b0-d2aaf71cced2 service nova] Enqueued Resource ID: 58316ca3-525d-4197-969c-1e363b6969c6 with Priority: HIGHEST for action security_group_rules [ 756.475384] env[65471]: INFO networking_nsxv3.common.synchronization [req-cb87e2de-6be4-409a-ba97-9c390dccf3c2 req-a2e356cb-1c6f-4c94-81b0-d2aaf71cced2 service nova] Enqueued Resource ID: 58316ca3-525d-4197-969c-1e363b6969c6 with Priority: HIGHEST for action security_group_members [ 756.475384] env[65471]: INFO networking_nsxv3.common.synchronization [req-cb87e2de-6be4-409a-ba97-9c390dccf3c2 req-a2e356cb-1c6f-4c94-81b0-d2aaf71cced2 service nova] Enqueued Resource ID: 5480bbba-c78e-4839-8b02-733211bab8b3 with Priority: HIGHEST for action port [ 756.475384] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58316ca3-525d-4197-969c-1e363b6969c6 with Priority: HIGHEST for action security_group_rules [ 756.475814] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58316ca3-525d-4197-969c-1e363b6969c6 with Priority: HIGHEST for action security_group_members [ 756.475814] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5480bbba-c78e-4839-8b02-733211bab8b3 with Priority: HIGHEST for action port [ 756.475906] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-58316ca3-525d-4197-969c-1e363b6969c6 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.476069] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-58316ca3-525d-4197-969c-1e363b6969c6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.476131] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-58316ca3-525d-4197-969c-1e363b6969c6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.476389] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-58316ca3-525d-4197-969c-1e363b6969c6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.476389] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('58316ca3-525d-4197-969c-1e363b6969c6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.480389] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-58316ca3-525d-4197-969c-1e363b6969c6 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.480630] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58316ca3-525d-4197-969c-1e363b6969c6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.480630] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58316ca3-525d-4197-969c-1e363b6969c6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.481030] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58316ca3-525d-4197-969c-1e363b6969c6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.481030] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.484439] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.484439] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.484439] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.484439] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.484439] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58316ca3-525d-4197-969c-1e363b6969c6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.484439] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-5480bbba-c78e-4839-8b02-733211bab8b3 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.484439] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5480bbba-c78e-4839-8b02-733211bab8b3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.484439] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5480bbba-c78e-4839-8b02-733211bab8b3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.485740] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5480bbba-c78e-4839-8b02-733211bab8b3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.485740] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5480bbba-c78e-4839-8b02-733211bab8b3',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.635651] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('14a38584-d8ef-4361-b344-b91e376144fa',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.848965] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.848965] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.848965] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.849332] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.849512] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.849617] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.849678] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.849840] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.849924] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.850019] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.850270] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.850451] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.850552] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.850634] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.850778] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.850882] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.850946] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.851361] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.851361] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.851361] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.851361] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b60bf9ef-6e65-4c6d-87e2-33b6bcafa939',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.988662] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-58316ca3-525d-4197-969c-1e363b6969c6 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.988745] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58316ca3-525d-4197-969c-1e363b6969c6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.988927] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('58316ca3-525d-4197-969c-1e363b6969c6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.989835] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5480bbba-c78e-4839-8b02-733211bab8b3 with status ACTIVE [ 756.990063] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.990200] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.990263] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.990525] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.990608] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.990870] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.990995] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.991073] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.991257] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.991334] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.991565] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.991669] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.991767] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.991911] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.991988] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.992089] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5480bbba-c78e-4839-8b02-733211bab8b3 is going to be updated. [ 757.023725] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.023920] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.024064] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.024693] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.024693] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.024693] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5480bbba-c78e-4839-8b02-733211bab8b3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.137433] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.137594] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.137754] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.137923] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.138043] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.138221] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14a38584-d8ef-4361-b344-b91e376144fa is going to be updated. [ 757.189127] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.189127] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.189127] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.189127] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.189127] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.200288] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14a38584-d8ef-4361-b344-b91e376144fa in Status: IN_PROGRESS for 2s [ 757.261975] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 927a7ac0-117d-4551-a979-a43f61af6c25 in Status: SUCCESS [ 757.262506] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-927a7ac0-117d-4551-a979-a43f61af6c25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.262807] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-927a7ac0-117d-4551-a979-a43f61af6c25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.263170] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-927a7ac0-117d-4551-a979-a43f61af6c25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.263384] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.263527] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.263598] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.263766] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.263853] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.263941] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-927a7ac0-117d-4551-a979-a43f61af6c25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.264057] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('927a7ac0-117d-4551-a979-a43f61af6c25',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.355378] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b60bf9ef-6e65-4c6d-87e2-33b6bcafa939: rpc.has_security_group_logging(os_id): False [ 757.377180] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.377180] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.377334] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.377468] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.377563] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.377815] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.379412] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.379412] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.379412] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.379412] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.379412] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.379412] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.379412] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.379412] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.379412] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.379412] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.379412] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.379412] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.379412] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.379412] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.380231] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 is going to be updated. [ 757.452868] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.452868] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.452868] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.453187] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.453187] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.467343] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 in Status: IN_PROGRESS for 2s [ 757.495550] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('58316ca3-525d-4197-969c-1e363b6969c6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.547040] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa1e565f-d426-4783-ad96-ca42d167f6b8 in Status: SUCCESS [ 757.547275] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa1e565f-d426-4783-ad96-ca42d167f6b8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.765994] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('927a7ac0-117d-4551-a979-a43f61af6c25',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.999809] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.999809] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.999809] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.999809] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.999809] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.999809] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58316ca3-525d-4197-969c-1e363b6969c6 is going to be created. [ 758.029193] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.029440] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.029440] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.029642] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.029801] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.042393] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58316ca3-525d-4197-969c-1e363b6969c6 in Status: UNINITIALIZED for 2s [ 758.273575] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 927a7ac0-117d-4551-a979-a43f61af6c25: rpc.has_security_group_logging(os_id): False [ 758.312830] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.313132] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.313951] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.313951] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.313951] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.314377] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.315044] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.315044] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.315310] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.315452] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.315643] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 927a7ac0-117d-4551-a979-a43f61af6c25 is going to be created. [ 758.437849] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.438088] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.438194] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.438680] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.438784] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.443148] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a9f3871-1bad-4130-b669-97b85ced692d in Status: SUCCESS [ 758.443397] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a9f3871-1bad-4130-b669-97b85ced692d deletion is rescheduled due to dependency. [ 758.443512] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a9f3871-1bad-4130-b669-97b85ced692d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.462233] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 927a7ac0-117d-4551-a979-a43f61af6c25 in Status: IN_PROGRESS for 2s [ 759.215389] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14a38584-d8ef-4361-b344-b91e376144fa in Status: SUCCESS [ 759.215675] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14a38584-d8ef-4361-b344-b91e376144fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.489391] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 in Status: SUCCESS [ 759.489849] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.059318] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58316ca3-525d-4197-969c-1e363b6969c6 in Status: SUCCESS [ 760.059318] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58316ca3-525d-4197-969c-1e363b6969c6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.059318] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58316ca3-525d-4197-969c-1e363b6969c6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.059318] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58316ca3-525d-4197-969c-1e363b6969c6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.059318] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.059318] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.059318] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.059318] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.059318] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.059318] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58316ca3-525d-4197-969c-1e363b6969c6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.059318] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('58316ca3-525d-4197-969c-1e363b6969c6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.478519] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 927a7ac0-117d-4551-a979-a43f61af6c25 in Status: SUCCESS [ 760.478791] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-927a7ac0-117d-4551-a979-a43f61af6c25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.564514] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('58316ca3-525d-4197-969c-1e363b6969c6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.830597] env[65471]: INFO networking_nsxv3.common.synchronization [req-0e364200-a352-4f42-bc50-88fb29357450 req-b73eccf5-7468-44c2-ac5d-2dfa2338bc0f tempest-TenantUsagesTestJSON-1320839399 tempest-TenantUsagesTestJSON-1320839399-project-member] Enqueued Resource ID: ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46 with Priority: HIGHEST for action security_group_members [ 760.832436] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46 with Priority: HIGHEST for action security_group_members [ 760.833467] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.833883] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.834167] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.834798] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.835715] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.835715] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.835899] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.836217] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.837236] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.837236] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.068624] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 58316ca3-525d-4197-969c-1e363b6969c6: rpc.has_security_group_logging(os_id): False [ 761.092606] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.092606] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.092606] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.092606] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.092606] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.093042] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.093042] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.093150] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.095076] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.095076] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.095076] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58316ca3-525d-4197-969c-1e363b6969c6 is going to be created. [ 761.172913] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.173699] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.173796] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.174056] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.174290] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.191676] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58316ca3-525d-4197-969c-1e363b6969c6 in Status: IN_PROGRESS for 2s [ 761.341269] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.341367] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.341502] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.341754] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.341891] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.342032] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.342149] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.342216] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.342391] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.342509] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.342551] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46 already deleted. [ 761.342634] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.352724] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock network-647 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.352981] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "network-647" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.353117] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "network-647" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.353382] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "network-647" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.353683] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.353839] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.353952] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.354189] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.354328] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.354545] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 761.354671] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 761.354780] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 761.354890] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 761.354995] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 761.355110] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 761.355235] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 761.415791] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 761.416179] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Cache value generated in 0.061 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 761.416378] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 761.416749] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "network-647" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.417225] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock port-ac15c8f1-a99e-412f-bf63-35966cbbeee8 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.417530] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "port-ac15c8f1-a99e-412f-bf63-35966cbbeee8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.418223] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "port-ac15c8f1-a99e-412f-bf63-35966cbbeee8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.418323] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "port-ac15c8f1-a99e-412f-bf63-35966cbbeee8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.418518] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac15c8f1-a99e-412f-bf63-35966cbbeee8',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.921928] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.922216] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.922348] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.922683] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.922869] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.923099] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Segment Port ac15c8f1-a99e-412f-bf63-35966cbbeee8 not found, creating... [ 761.923492] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.923673] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.923789] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.924141] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.924298] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.924589] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.924740] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.924848] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.925077] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.925209] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.925344] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Resource: SegmentPort with ID: ac15c8f1-a99e-412f-bf63-35966cbbeee8 is going to be created. [ 761.951293] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.951608] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.951747] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.952140] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.952433] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.952731] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "port-ac15c8f1-a99e-412f-bf63-35966cbbeee8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.633800] env[65471]: INFO networking_nsxv3.common.synchronization [req-0e364200-a352-4f42-bc50-88fb29357450 req-1b972f83-9af5-4ff2-853d-ad6a4b64928b service nova] Enqueued Resource ID: ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46 with Priority: HIGHEST for action security_group_rules [ 762.633800] env[65471]: INFO networking_nsxv3.common.synchronization [req-0e364200-a352-4f42-bc50-88fb29357450 req-1b972f83-9af5-4ff2-853d-ad6a4b64928b service nova] Enqueued Resource ID: ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46 with Priority: HIGHEST for action security_group_members [ 762.633800] env[65471]: INFO networking_nsxv3.common.synchronization [req-0e364200-a352-4f42-bc50-88fb29357450 req-1b972f83-9af5-4ff2-853d-ad6a4b64928b service nova] Enqueued Resource ID: ac15c8f1-a99e-412f-bf63-35966cbbeee8 with Priority: HIGHEST for action port [ 762.633800] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46 with Priority: HIGHEST for action security_group_rules [ 762.633800] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46 with Priority: HIGHEST for action security_group_members [ 762.633800] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac15c8f1-a99e-412f-bf63-35966cbbeee8 with Priority: HIGHEST for action port [ 762.634260] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.634354] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.634354] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.634638] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.634922] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.637071] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.637071] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.637323] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.637609] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.638123] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.638123] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.638123] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.638361] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.638361] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.638471] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.641630] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-ac15c8f1-a99e-412f-bf63-35966cbbeee8 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.641630] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ac15c8f1-a99e-412f-bf63-35966cbbeee8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.641630] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ac15c8f1-a99e-412f-bf63-35966cbbeee8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.641630] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ac15c8f1-a99e-412f-bf63-35966cbbeee8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.641630] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac15c8f1-a99e-412f-bf63-35966cbbeee8',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.664709] env[65471]: INFO networking_nsxv3.common.synchronization [req-aa433800-7738-45c7-8f20-23c7b0c62882 req-d6f54544-9a9f-478d-8266-9017a9324b92 tempest-FloatingIPsAssociationNegativeTestJSON-836224756 tempest-FloatingIPsAssociationNegativeTestJSON-836224756-project-member] Enqueued Resource ID: a976012d-6558-47ff-8d35-cffeac52b05f with Priority: HIGHEST for action security_group_members [ 762.665289] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a976012d-6558-47ff-8d35-cffeac52b05f with Priority: HIGHEST for action security_group_members [ 762.667356] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-a976012d-6558-47ff-8d35-cffeac52b05f taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.667511] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a976012d-6558-47ff-8d35-cffeac52b05f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.667605] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a976012d-6558-47ff-8d35-cffeac52b05f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.667838] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a976012d-6558-47ff-8d35-cffeac52b05f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.668054] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.668210] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.668298] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.668498] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.668600] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.668723] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a976012d-6558-47ff-8d35-cffeac52b05f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.142631] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.142631] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.142631] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.143247] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ac15c8f1-a99e-412f-bf63-35966cbbeee8 with status ACTIVE [ 763.143277] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.143378] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.143442] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.143657] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.144363] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.144363] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.144363] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.144363] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.144363] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.144363] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.144687] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.144757] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.144860] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.144979] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.145123] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.145224] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ac15c8f1-a99e-412f-bf63-35966cbbeee8 is going to be updated. [ 763.170685] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.170832] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.170992] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.171130] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.171266] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.171474] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ac15c8f1-a99e-412f-bf63-35966cbbeee8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.172275] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.172442] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.172542] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.172756] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.172846] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.173046] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.173148] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.173213] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.173360] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.173438] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.173525] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a976012d-6558-47ff-8d35-cffeac52b05f is going to be updated. [ 763.209230] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58316ca3-525d-4197-969c-1e363b6969c6 in Status: SUCCESS [ 763.209230] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-58316ca3-525d-4197-969c-1e363b6969c6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.209964] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.210088] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.210088] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.210826] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.210826] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.221412] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a976012d-6558-47ff-8d35-cffeac52b05f in Status: IN_PROGRESS for 2s [ 763.539641] env[65471]: INFO networking_nsxv3.common.synchronization [req-a18e04ba-e008-4a0a-a92d-edbb33a86b66 req-90460c7c-1d71-48aa-b07e-b0ee349bb714 tempest-ServerDiskConfigTestJSON-1443816332 tempest-ServerDiskConfigTestJSON-1443816332-project-member] Enqueued Resource ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e with Priority: HIGHEST for action security_group_members [ 763.540465] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e with Priority: HIGHEST for action security_group_members [ 763.540870] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.541018] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.542021] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.542021] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.542021] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.542021] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.542021] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.542258] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.542258] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.542318] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c8a6eda-c0ec-4e25-8652-6acf3d57da4e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.649485] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.045670] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.045924] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.046061] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.046310] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.046409] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.046685] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.046800] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.046866] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.047037] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.047125] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.047216] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e already deleted. [ 764.047299] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.091288] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock network-537 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.091288] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "network-537" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.091288] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "network-537" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.091288] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "network-537" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.091580] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.091802] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.092059] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.092299] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.092520] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.092738] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 764.092849] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 764.092979] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 764.093183] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 764.093316] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 764.093432] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 764.093567] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 764.120353] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 764.120614] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 764.120801] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 764.120988] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "network-537" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.121349] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock port-97e94fc1-fd3e-455f-a308-0016a25fc836 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.121522] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "port-97e94fc1-fd3e-455f-a308-0016a25fc836" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.121646] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "port-97e94fc1-fd3e-455f-a308-0016a25fc836" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.121984] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "port-97e94fc1-fd3e-455f-a308-0016a25fc836" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.122142] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97e94fc1-fd3e-455f-a308-0016a25fc836',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.154030] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.154030] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.154030] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.154505] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.154505] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.154505] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46 is going to be created. [ 764.197700] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.197911] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.198185] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.198461] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.198667] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.231968] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46 in Status: UNINITIALIZED for 2s [ 764.626789] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.627045] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.627154] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.627448] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.627594] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.627746] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Segment Port 97e94fc1-fd3e-455f-a308-0016a25fc836 not found, creating... [ 764.628014] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.628178] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.628289] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.628524] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.628637] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.628917] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.629349] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.629529] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.629778] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.629951] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.630152] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Resource: SegmentPort with ID: 97e94fc1-fd3e-455f-a308-0016a25fc836 is going to be created. [ 764.654555] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.654881] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.655054] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.655414] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.655578] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.655835] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "port-97e94fc1-fd3e-455f-a308-0016a25fc836" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.233868] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a976012d-6558-47ff-8d35-cffeac52b05f in Status: SUCCESS [ 765.234916] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a976012d-6558-47ff-8d35-cffeac52b05f deletion is rescheduled due to dependency. [ 765.235091] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a976012d-6558-47ff-8d35-cffeac52b05f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.327675] env[65471]: INFO networking_nsxv3.common.synchronization [req-d545b7a2-468c-417c-b862-6f6148170e54 req-3f579cac-da23-435e-8645-e14e0cb6e696 tempest-ListServersNegativeTestJSON-604387842 tempest-ListServersNegativeTestJSON-604387842-project-member] Enqueued Resource ID: 15cae89a-6005-4f02-95eb-d04ef2f8ea8e with Priority: HIGHEST for action security_group_members [ 765.328308] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15cae89a-6005-4f02-95eb-d04ef2f8ea8e with Priority: HIGHEST for action security_group_members [ 765.328722] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.328850] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.328921] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.329626] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.329626] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.329626] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.329626] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.329833] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.329833] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.329895] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15cae89a-6005-4f02-95eb-d04ef2f8ea8e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.467523] env[65471]: INFO networking_nsxv3.common.synchronization [req-a18e04ba-e008-4a0a-a92d-edbb33a86b66 req-1c7f47dc-4e64-479d-b382-27b302cee112 service nova] Enqueued Resource ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e with Priority: HIGHEST for action security_group_rules [ 765.467523] env[65471]: INFO networking_nsxv3.common.synchronization [req-a18e04ba-e008-4a0a-a92d-edbb33a86b66 req-1c7f47dc-4e64-479d-b382-27b302cee112 service nova] Enqueued Resource ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e with Priority: HIGHEST for action security_group_members [ 765.467523] env[65471]: INFO networking_nsxv3.common.synchronization [req-a18e04ba-e008-4a0a-a92d-edbb33a86b66 req-1c7f47dc-4e64-479d-b382-27b302cee112 service nova] Enqueued Resource ID: 97e94fc1-fd3e-455f-a308-0016a25fc836 with Priority: HIGHEST for action port [ 765.467523] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e with Priority: HIGHEST for action security_group_rules [ 765.467523] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e with Priority: HIGHEST for action security_group_members [ 765.467523] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97e94fc1-fd3e-455f-a308-0016a25fc836 with Priority: HIGHEST for action port [ 765.467523] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.467523] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.467523] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.467523] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.468474] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1c8a6eda-c0ec-4e25-8652-6acf3d57da4e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.470232] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.470391] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.470541] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.470763] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.471062] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.471222] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.471334] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.472343] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.472343] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.472343] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c8a6eda-c0ec-4e25-8652-6acf3d57da4e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.475699] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-97e94fc1-fd3e-455f-a308-0016a25fc836 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.475863] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-97e94fc1-fd3e-455f-a308-0016a25fc836" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.475953] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-97e94fc1-fd3e-455f-a308-0016a25fc836" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.476729] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-97e94fc1-fd3e-455f-a308-0016a25fc836" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.476854] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97e94fc1-fd3e-455f-a308-0016a25fc836',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.832360] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15cae89a-6005-4f02-95eb-d04ef2f8ea8e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.979304] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1c8a6eda-c0ec-4e25-8652-6acf3d57da4e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.982149] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.982413] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.982938] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 97e94fc1-fd3e-455f-a308-0016a25fc836 with status ACTIVE [ 765.984809] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.984991] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.985117] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.985409] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.985563] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.985876] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.986090] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.986246] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.986578] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.986698] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.986875] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.986985] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.987075] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.987304] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.987416] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.987780] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 97e94fc1-fd3e-455f-a308-0016a25fc836 is going to be updated. [ 766.026742] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.026742] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.026742] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.026742] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.026742] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.026742] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-97e94fc1-fd3e-455f-a308-0016a25fc836" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.245776] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46 in Status: SUCCESS [ 766.246363] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.246363] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.246577] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.246818] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.246964] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.247097] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.247250] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.247391] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.247509] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.247694] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.335801] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15cae89a-6005-4f02-95eb-d04ef2f8ea8e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.484016] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1c8a6eda-c0ec-4e25-8652-6acf3d57da4e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.757083] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.757083] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.757083] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.757083] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.757083] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.757083] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.757083] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.757083] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.757083] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.757083] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.757083] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.757083] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.757083] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.757842] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.757842] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.757842] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.757842] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.757842] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.757842] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.757842] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.757842] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.839844] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.840115] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.840242] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.840613] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.840771] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.840828] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15cae89a-6005-4f02-95eb-d04ef2f8ea8e is going to be updated. [ 766.891491] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.891726] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.892612] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.892612] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.892612] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.905229] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15cae89a-6005-4f02-95eb-d04ef2f8ea8e in Status: IN_PROGRESS for 2s [ 766.986416] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.986629] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.986629] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.986843] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.987038] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.987121] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e is going to be created. [ 767.050000] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.051235] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.051235] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.051235] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.051235] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.065597] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e in Status: UNINITIALIZED for 2s [ 767.258823] env[65471]: INFO networking_nsxv3.common.synchronization [req-c1d40040-c54d-492c-8d27-fe30b64f07d5 req-a700b6e8-b5ca-413e-b07b-a9ac582e122b tempest-ListServersNegativeTestJSON-604387842 tempest-ListServersNegativeTestJSON-604387842-project-member] Enqueued Resource ID: 15cae89a-6005-4f02-95eb-d04ef2f8ea8e with Priority: HIGHEST for action security_group_members [ 767.260267] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15cae89a-6005-4f02-95eb-d04ef2f8ea8e with Priority: HIGHEST for action security_group_members [ 767.260620] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46: rpc.has_security_group_logging(os_id): False [ 767.261946] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.262126] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.302485] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.302485] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.302485] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.302485] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.302485] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.302485] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.302485] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.302485] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.302485] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.303393] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.303393] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.303393] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.303393] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.303393] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.303393] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.303756] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.303756] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.303756] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.303899] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.303972] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.304069] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46 is going to be created. [ 767.429171] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.429171] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.429171] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.429171] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.429171] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.446135] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46 in Status: IN_PROGRESS for 2s [ 768.918637] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15cae89a-6005-4f02-95eb-d04ef2f8ea8e in Status: SUCCESS [ 768.919038] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.919104] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.919292] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.919485] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.919606] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.919673] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.919824] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.919906] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.920013] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15cae89a-6005-4f02-95eb-d04ef2f8ea8e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.088200] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e in Status: SUCCESS [ 769.088501] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.088793] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.089073] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.089200] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.089332] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.089404] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.089584] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.089656] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.089765] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.089914] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1c8a6eda-c0ec-4e25-8652-6acf3d57da4e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.422687] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.423059] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.423059] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.423237] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.423350] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.423668] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.423825] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.423825] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.424075] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.424075] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.424572] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15cae89a-6005-4f02-95eb-d04ef2f8ea8e is going to be updated. [ 769.462141] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.462141] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.462409] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.462549] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.462725] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.467038] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46 in Status: SUCCESS [ 769.467186] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.477185] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15cae89a-6005-4f02-95eb-d04ef2f8ea8e in Status: IN_PROGRESS for 2s [ 769.594513] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.594693] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.594849] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.595045] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.595502] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.595502] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.595502] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.595673] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.595673] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.595727] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.595830] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.595912] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.595991] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.596273] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.596417] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.596507] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.596562] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.596700] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.596779] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.597265] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.597265] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1c8a6eda-c0ec-4e25-8652-6acf3d57da4e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.099389] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e: rpc.has_security_group_logging(os_id): False [ 770.120975] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.121169] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.121251] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.121537] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.121684] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.122039] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.122196] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.122275] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.125879] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.125879] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.125879] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.125879] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.125879] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.125879] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.125879] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.125879] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.125879] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.125879] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.125879] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.125879] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.125879] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e is going to be created. [ 770.212283] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.212555] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.212555] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.212652] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.212832] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.227786] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e in Status: IN_PROGRESS for 2s [ 771.232443] env[65471]: INFO networking_nsxv3.common.synchronization [None req-97eb03e0-5d33-4bd9-b770-d49a543656f9 None None] Enqueued Resource ID: a42e8507-8b77-4c72-b47f-e315dc236dcb with Priority: HIGHEST for action port [ 771.237989] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a42e8507-8b77-4c72-b47f-e315dc236dcb with Priority: HIGHEST for action port [ 771.240022] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-a42e8507-8b77-4c72-b47f-e315dc236dcb taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.240022] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a42e8507-8b77-4c72-b47f-e315dc236dcb" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.240022] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a42e8507-8b77-4c72-b47f-e315dc236dcb" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.240022] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a42e8507-8b77-4c72-b47f-e315dc236dcb" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.240022] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a42e8507-8b77-4c72-b47f-e315dc236dcb',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.463739] env[65471]: INFO networking_nsxv3.common.synchronization [req-618aa529-fcb4-4252-8494-f085fb10ed6c req-4ec8d117-3374-467b-85e6-c62789b0e6cd tempest-ImagesOneServerNegativeTestJSON-124059679 tempest-ImagesOneServerNegativeTestJSON-124059679-project-member] Enqueued Resource ID: a3c5f688-9271-4722-84e9-69667c674933 with Priority: HIGHEST for action security_group_members [ 771.468512] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3c5f688-9271-4722-84e9-69667c674933 with Priority: HIGHEST for action security_group_members [ 771.469150] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3c5f688-9271-4722-84e9-69667c674933 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.469294] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.469364] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.469573] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.469725] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.469857] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.469902] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.470048] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.470145] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.470257] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a3c5f688-9271-4722-84e9-69667c674933',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.499544] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15cae89a-6005-4f02-95eb-d04ef2f8ea8e in Status: SUCCESS [ 771.499750] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15cae89a-6005-4f02-95eb-d04ef2f8ea8e deletion is rescheduled due to dependency. [ 771.499864] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.744039] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a42e8507-8b77-4c72-b47f-e315dc236dcb [ 771.744287] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.744449] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.744528] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.744763] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.744864] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.745523] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a42e8507-8b77-4c72-b47f-e315dc236dcb already deleted. [ 771.745523] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a42e8507-8b77-4c72-b47f-e315dc236dcb" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.975751] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.975751] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.976065] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.976065] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.976140] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.976299] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.976397] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.976469] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.976619] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.976692] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.976770] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3c5f688-9271-4722-84e9-69667c674933 is going to be updated. [ 772.025334] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.025527] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.025527] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.025820] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.025938] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.060114] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3c5f688-9271-4722-84e9-69667c674933 in Status: IN_PROGRESS for 2s [ 772.245742] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e in Status: SUCCESS [ 772.246057] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.459127] env[65471]: INFO networking_nsxv3.common.synchronization [None req-ef58f76c-7b48-4e8e-bfb6-e667fdcf818f tempest-AttachInterfacesTestJSON-1197806586 tempest-AttachInterfacesTestJSON-1197806586-project-member] Enqueued Resource ID: 1b605f75-31b8-4209-be69-e1c60e682aa5 with Priority: HIGHEST for action security_group_rules [ 772.460307] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b605f75-31b8-4209-be69-e1c60e682aa5 with Priority: HIGHEST for action security_group_rules [ 772.460853] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1b605f75-31b8-4209-be69-e1c60e682aa5 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.461165] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1b605f75-31b8-4209-be69-e1c60e682aa5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.461327] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1b605f75-31b8-4209-be69-e1c60e682aa5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.461682] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1b605f75-31b8-4209-be69-e1c60e682aa5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.461859] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1b605f75-31b8-4209-be69-e1c60e682aa5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.627900] env[65471]: INFO networking_nsxv3.common.synchronization [None req-c2685f3f-8320-4c33-aff0-e909686ee17e tempest-AttachInterfacesTestJSON-1197806586 tempest-AttachInterfacesTestJSON-1197806586-project-member] Enqueued Resource ID: 1b605f75-31b8-4209-be69-e1c60e682aa5 with Priority: HIGHEST for action security_group_rules [ 772.628700] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b605f75-31b8-4209-be69-e1c60e682aa5 with Priority: HIGHEST for action security_group_rules [ 772.629115] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1b605f75-31b8-4209-be69-e1c60e682aa5 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.629218] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1b605f75-31b8-4209-be69-e1c60e682aa5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.991685] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.991969] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.992110] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.992406] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.992564] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.992717] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b605f75-31b8-4209-be69-e1c60e682aa5 already deleted. [ 772.992963] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1b605f75-31b8-4209-be69-e1c60e682aa5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.993541] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1b605f75-31b8-4209-be69-e1c60e682aa5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.993849] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1b605f75-31b8-4209-be69-e1c60e682aa5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.994031] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1b605f75-31b8-4209-be69-e1c60e682aa5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.517888] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.518196] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.518196] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.518728] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.518728] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.518728] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b605f75-31b8-4209-be69-e1c60e682aa5 already deleted. [ 773.518728] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1b605f75-31b8-4209-be69-e1c60e682aa5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.985330] env[65471]: INFO networking_nsxv3.common.synchronization [None req-bb2af1d0-10b8-4b96-a219-6fdbac0a09b4 tempest-MigrationsAdminTest-433965692 tempest-MigrationsAdminTest-433965692-project-member] Enqueued Resource ID: f1072d4e-24c4-4e06-bd98-9cea1de74ad1 with Priority: HIGHEST for action security_group_rules [ 773.994515] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1072d4e-24c4-4e06-bd98-9cea1de74ad1 with Priority: HIGHEST for action security_group_rules [ 773.999026] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f1072d4e-24c4-4e06-bd98-9cea1de74ad1 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.999026] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f1072d4e-24c4-4e06-bd98-9cea1de74ad1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.999026] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f1072d4e-24c4-4e06-bd98-9cea1de74ad1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.999026] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f1072d4e-24c4-4e06-bd98-9cea1de74ad1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.999026] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f1072d4e-24c4-4e06-bd98-9cea1de74ad1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.075027] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3c5f688-9271-4722-84e9-69667c674933 in Status: SUCCESS [ 774.075027] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3c5f688-9271-4722-84e9-69667c674933 deletion is rescheduled due to dependency. [ 774.075027] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.144995] env[65471]: INFO networking_nsxv3.common.synchronization [None req-6334771a-bda3-4718-b50a-ac9662eaa5af tempest-MigrationsAdminTest-433965692 tempest-MigrationsAdminTest-433965692-project-member] Enqueued Resource ID: f1072d4e-24c4-4e06-bd98-9cea1de74ad1 with Priority: HIGHEST for action security_group_rules [ 774.144995] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1072d4e-24c4-4e06-bd98-9cea1de74ad1 with Priority: HIGHEST for action security_group_rules [ 774.145238] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f1072d4e-24c4-4e06-bd98-9cea1de74ad1 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.145334] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f1072d4e-24c4-4e06-bd98-9cea1de74ad1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.518771] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.521023] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.521023] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.521023] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.521023] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.521023] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f1072d4e-24c4-4e06-bd98-9cea1de74ad1 already deleted. [ 774.521023] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f1072d4e-24c4-4e06-bd98-9cea1de74ad1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.521023] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f1072d4e-24c4-4e06-bd98-9cea1de74ad1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.521023] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f1072d4e-24c4-4e06-bd98-9cea1de74ad1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.521632] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f1072d4e-24c4-4e06-bd98-9cea1de74ad1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.571739] env[65471]: INFO networking_nsxv3.common.synchronization [None req-820edfdf-c6e2-4917-9bba-18510d4de2ba None None] Enqueued Resource ID: 8f56e897-de85-44c6-954e-7b2b0c4dc3f9 with Priority: HIGHEST for action port [ 774.574952] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f56e897-de85-44c6-954e-7b2b0c4dc3f9 with Priority: HIGHEST for action port [ 774.574952] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-8f56e897-de85-44c6-954e-7b2b0c4dc3f9 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.574952] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8f56e897-de85-44c6-954e-7b2b0c4dc3f9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.574952] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8f56e897-de85-44c6-954e-7b2b0c4dc3f9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.574952] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8f56e897-de85-44c6-954e-7b2b0c4dc3f9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.574952] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f56e897-de85-44c6-954e-7b2b0c4dc3f9',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.953324] env[65471]: INFO networking_nsxv3.common.synchronization [req-a0e8b5bd-d98c-4407-afbc-b9736921a2b0 req-8fac1dc6-73f9-482f-a251-a293556fe4e0 tempest-FloatingIPsAssociationTestJSON-777761534 tempest-FloatingIPsAssociationTestJSON-777761534-project-member] Enqueued Resource ID: fc157df5-294c-4a29-82ae-e1ec842611f3 with Priority: HIGHEST for action security_group_members [ 774.954025] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc157df5-294c-4a29-82ae-e1ec842611f3 with Priority: HIGHEST for action security_group_members [ 774.954325] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc157df5-294c-4a29-82ae-e1ec842611f3 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.954474] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc157df5-294c-4a29-82ae-e1ec842611f3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.954560] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc157df5-294c-4a29-82ae-e1ec842611f3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.954807] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc157df5-294c-4a29-82ae-e1ec842611f3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.954985] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.956236] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.956356] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.956568] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.956667] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.956776] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc157df5-294c-4a29-82ae-e1ec842611f3',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.049022] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.049022] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.049022] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.049248] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.049334] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.049436] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f1072d4e-24c4-4e06-bd98-9cea1de74ad1 already deleted. [ 775.049619] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f1072d4e-24c4-4e06-bd98-9cea1de74ad1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.076270] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8f56e897-de85-44c6-954e-7b2b0c4dc3f9 [ 775.076604] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.076707] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.076707] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.077854] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.077854] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.077854] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8f56e897-de85-44c6-954e-7b2b0c4dc3f9 already deleted. [ 775.077854] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8f56e897-de85-44c6-954e-7b2b0c4dc3f9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.459957] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.459957] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.459957] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.460338] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.460396] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.461031] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.461031] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.461031] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.461206] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.461323] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.461422] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc157df5-294c-4a29-82ae-e1ec842611f3 is going to be updated. [ 775.495272] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.495272] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.495272] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.495272] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.495272] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.506483] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc157df5-294c-4a29-82ae-e1ec842611f3 in Status: IN_PROGRESS for 2s [ 776.006677] env[65471]: INFO networking_nsxv3.common.synchronization [req-4a71943e-8b6e-40c4-b865-db7bca75dcd9 req-99ee3357-977d-4b17-94ac-cc16e6ab94e2 tempest-ImagesTestJSON-650286870 tempest-ImagesTestJSON-650286870-project-member] Enqueued Resource ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f with Priority: HIGHEST for action security_group_members [ 776.007781] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f with Priority: HIGHEST for action security_group_members [ 776.008486] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-85af6c5e-2f9b-491d-9584-96c44b20f99f taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.008866] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.008963] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.009343] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.009604] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.010039] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.010413] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.011184] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.011628] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.012176] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85af6c5e-2f9b-491d-9584-96c44b20f99f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.516064] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.516335] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.516415] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.516684] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.516798] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.517092] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.517219] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.517308] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.517660] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.517660] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.517660] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f is going to be updated. [ 776.551886] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.552048] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.552244] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.552348] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.552493] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.563988] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f in Status: IN_PROGRESS for 2s [ 777.520335] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc157df5-294c-4a29-82ae-e1ec842611f3 in Status: SUCCESS [ 777.520335] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc157df5-294c-4a29-82ae-e1ec842611f3 deletion is rescheduled due to dependency. [ 777.520335] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc157df5-294c-4a29-82ae-e1ec842611f3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.573185] env[65471]: INFO networking_nsxv3.common.synchronization [req-cbd51765-89a8-45b6-b16b-e2c18656f9f5 req-57b87dca-9743-4ceb-8103-f59df29ecb20 tempest-ServerMetadataNegativeTestJSON-1367000542 tempest-ServerMetadataNegativeTestJSON-1367000542-project-member] Enqueued Resource ID: 0dea54fa-53b9-4eb3-a0a7-ce06500a230a with Priority: HIGHEST for action security_group_members [ 777.573743] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dea54fa-53b9-4eb3-a0a7-ce06500a230a with Priority: HIGHEST for action security_group_members [ 777.574077] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dea54fa-53b9-4eb3-a0a7-ce06500a230a taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.574217] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dea54fa-53b9-4eb3-a0a7-ce06500a230a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.574281] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dea54fa-53b9-4eb3-a0a7-ce06500a230a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.574534] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dea54fa-53b9-4eb3-a0a7-ce06500a230a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.574959] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.574959] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.574959] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.576578] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.576578] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.576578] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0dea54fa-53b9-4eb3-a0a7-ce06500a230a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.998266] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock network-332 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.998266] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "network-332" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.998266] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "network-332" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.998266] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "network-332" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.998266] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.998266] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.998266] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.998266] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.998266] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.998266] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 777.999179] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 777.999179] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 777.999179] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 777.999179] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 777.999179] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 777.999674] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 778.022020] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 778.022219] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 778.022356] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 778.022538] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "network-332" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.022882] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock port-3c12d8d4-b7dd-43a5-9f62-1a046a9ca797 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.023380] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "port-3c12d8d4-b7dd-43a5-9f62-1a046a9ca797" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.023380] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "port-3c12d8d4-b7dd-43a5-9f62-1a046a9ca797" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.023530] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "port-3c12d8d4-b7dd-43a5-9f62-1a046a9ca797" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.023995] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c12d8d4-b7dd-43a5-9f62-1a046a9ca797',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.077989] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.078316] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.078445] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.078789] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.079323] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.079633] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.080339] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.080339] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.080339] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.080339] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.080339] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dea54fa-53b9-4eb3-a0a7-ce06500a230a already deleted. [ 778.080339] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dea54fa-53b9-4eb3-a0a7-ce06500a230a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.527133] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.527447] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.527492] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.527895] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.528290] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.528470] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Segment Port 3c12d8d4-b7dd-43a5-9f62-1a046a9ca797 not found, creating... [ 778.528801] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.529042] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.529205] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.529461] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.529628] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.529971] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.530131] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.530244] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.530471] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.530646] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.530792] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Resource: SegmentPort with ID: 3c12d8d4-b7dd-43a5-9f62-1a046a9ca797 is going to be created. [ 778.555500] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.555712] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.555910] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.556266] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.556510] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.556747] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "port-3c12d8d4-b7dd-43a5-9f62-1a046a9ca797" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.575621] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f in Status: SUCCESS [ 778.575895] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f deletion is rescheduled due to dependency. [ 778.576067] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.338974] env[65471]: INFO networking_nsxv3.common.synchronization [req-cbd51765-89a8-45b6-b16b-e2c18656f9f5 req-e81a9ad3-168a-49fa-899b-2074ad60cb61 service nova] Enqueued Resource ID: 0dea54fa-53b9-4eb3-a0a7-ce06500a230a with Priority: HIGHEST for action security_group_rules [ 779.338974] env[65471]: INFO networking_nsxv3.common.synchronization [req-cbd51765-89a8-45b6-b16b-e2c18656f9f5 req-e81a9ad3-168a-49fa-899b-2074ad60cb61 service nova] Enqueued Resource ID: 0dea54fa-53b9-4eb3-a0a7-ce06500a230a with Priority: HIGHEST for action security_group_members [ 779.343665] env[65471]: INFO networking_nsxv3.common.synchronization [req-cbd51765-89a8-45b6-b16b-e2c18656f9f5 req-e81a9ad3-168a-49fa-899b-2074ad60cb61 service nova] Enqueued Resource ID: 3c12d8d4-b7dd-43a5-9f62-1a046a9ca797 with Priority: HIGHEST for action port [ 779.343665] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dea54fa-53b9-4eb3-a0a7-ce06500a230a with Priority: HIGHEST for action security_group_rules [ 779.343665] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dea54fa-53b9-4eb3-a0a7-ce06500a230a with Priority: HIGHEST for action security_group_members [ 779.343665] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c12d8d4-b7dd-43a5-9f62-1a046a9ca797 with Priority: HIGHEST for action port [ 779.343665] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0dea54fa-53b9-4eb3-a0a7-ce06500a230a taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.343665] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0dea54fa-53b9-4eb3-a0a7-ce06500a230a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.343665] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0dea54fa-53b9-4eb3-a0a7-ce06500a230a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.343665] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0dea54fa-53b9-4eb3-a0a7-ce06500a230a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.343665] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0dea54fa-53b9-4eb3-a0a7-ce06500a230a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.343665] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dea54fa-53b9-4eb3-a0a7-ce06500a230a taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.343665] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dea54fa-53b9-4eb3-a0a7-ce06500a230a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.343665] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dea54fa-53b9-4eb3-a0a7-ce06500a230a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.343665] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dea54fa-53b9-4eb3-a0a7-ce06500a230a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.344446] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.344446] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.344446] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.344446] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.344446] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.344446] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0dea54fa-53b9-4eb3-a0a7-ce06500a230a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.346115] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-3c12d8d4-b7dd-43a5-9f62-1a046a9ca797 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.346115] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3c12d8d4-b7dd-43a5-9f62-1a046a9ca797" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.346482] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3c12d8d4-b7dd-43a5-9f62-1a046a9ca797" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.346771] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3c12d8d4-b7dd-43a5-9f62-1a046a9ca797" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.346771] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c12d8d4-b7dd-43a5-9f62-1a046a9ca797',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.675583] env[65471]: INFO networking_nsxv3.common.synchronization [req-4b4e05ba-e861-48ec-8140-eee780fa70f0 req-30e8f16b-1897-4d5e-91f5-7b164056524f tempest-TenantUsagesTestJSON-1320839399 tempest-TenantUsagesTestJSON-1320839399-project-member] Enqueued Resource ID: ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46 with Priority: HIGHEST for action security_group_members [ 779.676236] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46 with Priority: HIGHEST for action security_group_members [ 779.676675] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.676675] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.676675] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.676904] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.676961] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.677175] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.677261] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.677421] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.677508] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.677605] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.849218] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dea54fa-53b9-4eb3-a0a7-ce06500a230a taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.850019] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dea54fa-53b9-4eb3-a0a7-ce06500a230a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.850019] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0dea54fa-53b9-4eb3-a0a7-ce06500a230a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.850507] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3c12d8d4-b7dd-43a5-9f62-1a046a9ca797 with status ACTIVE [ 779.850735] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.850855] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.850919] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.851647] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.851647] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.851647] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.851647] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.851647] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.851915] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.851915] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.852041] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.853025] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.853025] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.853025] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.853025] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.853025] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3c12d8d4-b7dd-43a5-9f62-1a046a9ca797 is going to be updated. [ 779.876516] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.876704] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.876806] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.877074] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.877252] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.877456] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3c12d8d4-b7dd-43a5-9f62-1a046a9ca797" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.179639] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.179803] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.179878] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.180207] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.180310] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.180518] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.180636] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.180705] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.180876] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.180956] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.181057] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46 is going to be updated. [ 780.213265] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.213427] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.213521] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.213764] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.213916] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.224994] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46 in Status: IN_PROGRESS for 2s [ 780.355352] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0dea54fa-53b9-4eb3-a0a7-ce06500a230a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.860538] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.860538] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.860538] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.860538] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.860538] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.860538] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dea54fa-53b9-4eb3-a0a7-ce06500a230a is going to be created. [ 780.884142] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.884280] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.884346] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.884550] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.884706] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.895557] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dea54fa-53b9-4eb3-a0a7-ce06500a230a in Status: UNINITIALIZED for 2s [ 782.244809] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46 in Status: SUCCESS [ 782.244809] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46 deletion is rescheduled due to dependency. [ 782.244809] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.907333] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dea54fa-53b9-4eb3-a0a7-ce06500a230a in Status: SUCCESS [ 782.908550] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dea54fa-53b9-4eb3-a0a7-ce06500a230a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.908550] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dea54fa-53b9-4eb3-a0a7-ce06500a230a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.908550] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dea54fa-53b9-4eb3-a0a7-ce06500a230a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.908550] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.908550] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.908550] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.909859] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.909859] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.909859] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dea54fa-53b9-4eb3-a0a7-ce06500a230a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.909859] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0dea54fa-53b9-4eb3-a0a7-ce06500a230a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.975844] env[65471]: INFO networking_nsxv3.common.synchronization [req-81b423ea-5779-4ed7-9463-712763b550b3 req-ac0a3484-62ed-40c6-99f9-d59c9f56d7eb tempest-ServersAdminNegativeTestJSON-7494399 tempest-ServersAdminNegativeTestJSON-7494399-project-member] Enqueued Resource ID: 14a38584-d8ef-4361-b344-b91e376144fa with Priority: HIGHEST for action security_group_members [ 782.976428] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14a38584-d8ef-4361-b344-b91e376144fa with Priority: HIGHEST for action security_group_members [ 782.976829] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-14a38584-d8ef-4361-b344-b91e376144fa taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.976931] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14a38584-d8ef-4361-b344-b91e376144fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.976931] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14a38584-d8ef-4361-b344-b91e376144fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.978336] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14a38584-d8ef-4361-b344-b91e376144fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.978460] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.978576] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.978646] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.978853] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.978965] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.979051] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14a38584-d8ef-4361-b344-b91e376144fa',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.416981] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dea54fa-53b9-4eb3-a0a7-ce06500a230a taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.417309] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dea54fa-53b9-4eb3-a0a7-ce06500a230a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.417309] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dea54fa-53b9-4eb3-a0a7-ce06500a230a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.417492] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dea54fa-53b9-4eb3-a0a7-ce06500a230a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.417694] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.417804] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.417905] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.418047] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.418149] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.418229] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dea54fa-53b9-4eb3-a0a7-ce06500a230a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.418510] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dea54fa-53b9-4eb3-a0a7-ce06500a230a taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.418640] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dea54fa-53b9-4eb3-a0a7-ce06500a230a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.418700] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dea54fa-53b9-4eb3-a0a7-ce06500a230a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.418845] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dea54fa-53b9-4eb3-a0a7-ce06500a230a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.418996] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.419217] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.419217] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.419343] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.419418] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.419503] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dea54fa-53b9-4eb3-a0a7-ce06500a230a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.419638] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0dea54fa-53b9-4eb3-a0a7-ce06500a230a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.481540] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.481859] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.481963] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.482155] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.508108] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.508108] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.508108] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.508108] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.508372] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.508450] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.508524] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14a38584-d8ef-4361-b344-b91e376144fa is going to be updated. [ 783.545582] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.546284] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.546436] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.546693] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.546873] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.557648] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14a38584-d8ef-4361-b344-b91e376144fa in Status: IN_PROGRESS for 2s [ 783.853790] env[65471]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] NSXv3 Agent Agent loop - iteration:0 completed [ 783.853923] env[65471]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] NSXv3 Agent Agent loop - iteration:1 started [ 783.923089] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0dea54fa-53b9-4eb3-a0a7-ce06500a230a: rpc.has_security_group_logging(os_id): False [ 783.942356] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.942520] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.942576] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.942785] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.942886] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.943110] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.943217] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.943258] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.943406] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.943474] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.943646] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.943737] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.943797] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.943933] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.944013] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.944206] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.944299] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.944359] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.944511] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.945933] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.946131] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0dea54fa-53b9-4eb3-a0a7-ce06500a230a is going to be created. [ 784.011835] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.014038] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.014038] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.014038] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.014038] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.027579] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0dea54fa-53b9-4eb3-a0a7-ce06500a230a in Status: IN_PROGRESS for 2s [ 784.839969] env[65471]: INFO networking_nsxv3.common.synchronization [req-f1bb4b91-417d-401e-81fb-45e3fa19cfff req-ea1cd4a2-9f10-49bf-87a1-2509a65f9d70 tempest-ServerDiagnosticsNegativeTest-241749810 tempest-ServerDiagnosticsNegativeTest-241749810-project-member] Enqueued Resource ID: cef82843-870a-4b3f-b81f-86da463af87e with Priority: HIGHEST for action security_group_members [ 784.840702] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cef82843-870a-4b3f-b81f-86da463af87e with Priority: HIGHEST for action security_group_members [ 784.841125] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-cef82843-870a-4b3f-b81f-86da463af87e taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.841329] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cef82843-870a-4b3f-b81f-86da463af87e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.841408] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cef82843-870a-4b3f-b81f-86da463af87e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.841677] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cef82843-870a-4b3f-b81f-86da463af87e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.841840] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.842216] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.842216] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.842216] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.842216] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.842422] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cef82843-870a-4b3f-b81f-86da463af87e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.216383] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock network-647 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.216707] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "network-647" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.216707] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "network-647" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.216972] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "network-647" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.217247] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.217395] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.217504] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.217707] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.217846] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.218220] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 785.218355] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 785.218461] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 785.219211] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 785.219211] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 785.219211] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 785.219211] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 785.237741] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 785.237901] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 785.238094] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 785.238406] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "network-647" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.239655] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock port-05082757-6739-4b30-bd77-394bc1bf656e taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.239655] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "port-05082757-6739-4b30-bd77-394bc1bf656e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.239655] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "port-05082757-6739-4b30-bd77-394bc1bf656e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.239655] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "port-05082757-6739-4b30-bd77-394bc1bf656e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.239655] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05082757-6739-4b30-bd77-394bc1bf656e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.345412] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.346733] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.347061] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.347386] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.347725] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.348785] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.348785] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.348785] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.348785] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.348785] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.348785] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cef82843-870a-4b3f-b81f-86da463af87e already deleted. [ 785.348785] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cef82843-870a-4b3f-b81f-86da463af87e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.569023] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14a38584-d8ef-4361-b344-b91e376144fa in Status: SUCCESS [ 785.569275] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14a38584-d8ef-4361-b344-b91e376144fa deletion is rescheduled due to dependency. [ 785.569469] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14a38584-d8ef-4361-b344-b91e376144fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.743079] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.743079] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.743079] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.743079] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.743079] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.743079] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Segment Port 05082757-6739-4b30-bd77-394bc1bf656e not found, creating... [ 785.743632] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.743751] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.743899] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.744205] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.744407] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.744733] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.744890] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.745000] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.745229] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.745358] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.745494] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Resource: SegmentPort with ID: 05082757-6739-4b30-bd77-394bc1bf656e is going to be created. [ 785.767521] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.767823] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.767926] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.768221] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.768403] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.768628] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "port-05082757-6739-4b30-bd77-394bc1bf656e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.042978] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0dea54fa-53b9-4eb3-a0a7-ce06500a230a in Status: SUCCESS [ 786.043302] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0dea54fa-53b9-4eb3-a0a7-ce06500a230a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.522660] env[65471]: INFO networking_nsxv3.common.synchronization [req-f1bb4b91-417d-401e-81fb-45e3fa19cfff req-8f269f45-7790-478b-bde8-d35e8640860a service nova] Enqueued Resource ID: cef82843-870a-4b3f-b81f-86da463af87e with Priority: HIGHEST for action security_group_rules [ 786.522892] env[65471]: INFO networking_nsxv3.common.synchronization [req-f1bb4b91-417d-401e-81fb-45e3fa19cfff req-8f269f45-7790-478b-bde8-d35e8640860a service nova] Enqueued Resource ID: cef82843-870a-4b3f-b81f-86da463af87e with Priority: HIGHEST for action security_group_members [ 786.529010] env[65471]: INFO networking_nsxv3.common.synchronization [req-f1bb4b91-417d-401e-81fb-45e3fa19cfff req-8f269f45-7790-478b-bde8-d35e8640860a service nova] Enqueued Resource ID: 05082757-6739-4b30-bd77-394bc1bf656e with Priority: HIGHEST for action port [ 786.529984] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cef82843-870a-4b3f-b81f-86da463af87e with Priority: HIGHEST for action security_group_rules [ 786.532181] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cef82843-870a-4b3f-b81f-86da463af87e with Priority: HIGHEST for action security_group_members [ 786.532181] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05082757-6739-4b30-bd77-394bc1bf656e with Priority: HIGHEST for action port [ 786.532181] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cef82843-870a-4b3f-b81f-86da463af87e taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.532181] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cef82843-870a-4b3f-b81f-86da463af87e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.532181] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cef82843-870a-4b3f-b81f-86da463af87e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.532181] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cef82843-870a-4b3f-b81f-86da463af87e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.532181] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cef82843-870a-4b3f-b81f-86da463af87e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.533274] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-cef82843-870a-4b3f-b81f-86da463af87e taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.533466] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cef82843-870a-4b3f-b81f-86da463af87e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.533562] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cef82843-870a-4b3f-b81f-86da463af87e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.533821] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cef82843-870a-4b3f-b81f-86da463af87e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.535755] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.535824] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.535931] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.536199] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.536332] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.536477] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cef82843-870a-4b3f-b81f-86da463af87e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.541711] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-05082757-6739-4b30-bd77-394bc1bf656e taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.541711] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-05082757-6739-4b30-bd77-394bc1bf656e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.541711] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-05082757-6739-4b30-bd77-394bc1bf656e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.541711] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-05082757-6739-4b30-bd77-394bc1bf656e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.541711] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05082757-6739-4b30-bd77-394bc1bf656e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.633822] env[65471]: INFO networking_nsxv3.common.synchronization [req-144236bf-ca49-47e9-9b89-fb6d390d3607 req-3b4ec565-6bad-4a8a-bee3-217ec28c55a7 tempest-ServersAdminTestJSON-1197360877 tempest-ServersAdminTestJSON-1197360877-project-member] Enqueued Resource ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 with Priority: HIGHEST for action security_group_members [ 786.635769] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 with Priority: HIGHEST for action security_group_members [ 786.636929] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4ca8456-5b21-4080-b762-7b52a4837eb1 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.637089] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.637169] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.637536] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.637676] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.637792] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.637866] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.638061] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.638116] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.638220] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4ca8456-5b21-4080-b762-7b52a4837eb1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.044138] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-cef82843-870a-4b3f-b81f-86da463af87e taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.044551] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cef82843-870a-4b3f-b81f-86da463af87e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.044631] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cef82843-870a-4b3f-b81f-86da463af87e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.046059] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 05082757-6739-4b30-bd77-394bc1bf656e with status ACTIVE [ 787.046059] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.046272] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.046333] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.046613] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.046769] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.047996] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.047996] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.047996] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.048185] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.048279] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.048668] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.048794] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.048794] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.048960] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.049047] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.049348] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 05082757-6739-4b30-bd77-394bc1bf656e is going to be updated. [ 787.085665] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.085869] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.085869] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.086162] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.086340] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.086554] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-05082757-6739-4b30-bd77-394bc1bf656e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.141357] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e4ca8456-5b21-4080-b762-7b52a4837eb1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.551208] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cef82843-870a-4b3f-b81f-86da463af87e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.644036] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e4ca8456-5b21-4080-b762-7b52a4837eb1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.056093] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.056093] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.056093] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.056093] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.056093] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.056093] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cef82843-870a-4b3f-b81f-86da463af87e is going to be created. [ 788.085502] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.085620] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.085620] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.086424] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.086424] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.098979] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cef82843-870a-4b3f-b81f-86da463af87e in Status: UNINITIALIZED for 2s [ 788.147309] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.147530] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.147620] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.147893] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.148034] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.148144] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 is going to be updated. [ 788.183074] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.183218] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.183218] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.183448] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.183658] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.202330] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 in Status: IN_PROGRESS for 2s [ 789.833383] env[65471]: INFO networking_nsxv3.common.synchronization [req-a75edfcc-f994-41df-8252-9c930546fa98 req-0cd74b7a-8347-4f5e-b9a4-78ae3abac0a0 tempest-ServerDiskConfigTestJSON-1443816332 tempest-ServerDiskConfigTestJSON-1443816332-project-member] Enqueued Resource ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e with Priority: HIGHEST for action security_group_members [ 789.833913] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e with Priority: HIGHEST for action security_group_members [ 789.834247] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.834368] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.834434] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.834625] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.835155] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.835155] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.835312] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.836043] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.837022] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.837168] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c8a6eda-c0ec-4e25-8652-6acf3d57da4e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.112253] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cef82843-870a-4b3f-b81f-86da463af87e in Status: SUCCESS [ 790.112445] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cef82843-870a-4b3f-b81f-86da463af87e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.112741] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cef82843-870a-4b3f-b81f-86da463af87e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.112974] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cef82843-870a-4b3f-b81f-86da463af87e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.113207] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.113366] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.113427] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.114107] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.116515] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.116515] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cef82843-870a-4b3f-b81f-86da463af87e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.116515] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cef82843-870a-4b3f-b81f-86da463af87e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.214145] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 in Status: SUCCESS [ 790.214145] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.342105] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.342232] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.342293] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.342487] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.342599] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.342932] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.342932] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.343078] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.343179] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.343244] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.343289] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e is going to be updated. [ 790.373252] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.373415] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.373452] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.373657] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.373807] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.384968] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e in Status: IN_PROGRESS for 2s [ 790.620122] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-cef82843-870a-4b3f-b81f-86da463af87e taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.620368] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cef82843-870a-4b3f-b81f-86da463af87e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.620425] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cef82843-870a-4b3f-b81f-86da463af87e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.620816] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cef82843-870a-4b3f-b81f-86da463af87e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.621034] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.621134] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.621200] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.621362] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.621445] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.621529] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cef82843-870a-4b3f-b81f-86da463af87e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.621676] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-cef82843-870a-4b3f-b81f-86da463af87e taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.621769] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cef82843-870a-4b3f-b81f-86da463af87e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.622202] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cef82843-870a-4b3f-b81f-86da463af87e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.622202] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cef82843-870a-4b3f-b81f-86da463af87e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.622202] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.622202] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.622473] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.622473] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.622604] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.622749] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cef82843-870a-4b3f-b81f-86da463af87e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.622899] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cef82843-870a-4b3f-b81f-86da463af87e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.130428] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cef82843-870a-4b3f-b81f-86da463af87e: rpc.has_security_group_logging(os_id): False [ 791.150753] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.150976] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.150976] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.151105] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.151908] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.151908] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.151908] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.151908] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.151908] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.152202] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.152202] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.152393] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.152393] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.152520] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.152520] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.153359] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.153359] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.153359] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.153359] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.153359] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.153359] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cef82843-870a-4b3f-b81f-86da463af87e is going to be created. [ 791.214049] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.214634] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.214634] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.214634] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.214945] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.228798] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cef82843-870a-4b3f-b81f-86da463af87e in Status: IN_PROGRESS for 2s [ 791.850961] env[65471]: INFO networking_nsxv3.common.synchronization [req-56a39a94-75de-48ed-98ed-48bec8c3c71f req-f5663105-531b-4037-9500-702cbe1c0d54 tempest-ServerMetadataNegativeTestJSON-1367000542 tempest-ServerMetadataNegativeTestJSON-1367000542-project-member] Enqueued Resource ID: 0dea54fa-53b9-4eb3-a0a7-ce06500a230a with Priority: HIGHEST for action security_group_members [ 791.851593] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dea54fa-53b9-4eb3-a0a7-ce06500a230a with Priority: HIGHEST for action security_group_members [ 791.854964] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dea54fa-53b9-4eb3-a0a7-ce06500a230a taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.854964] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dea54fa-53b9-4eb3-a0a7-ce06500a230a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.854964] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dea54fa-53b9-4eb3-a0a7-ce06500a230a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.854964] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dea54fa-53b9-4eb3-a0a7-ce06500a230a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.855372] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.855372] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.855372] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.855372] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.855517] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.855627] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0dea54fa-53b9-4eb3-a0a7-ce06500a230a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.359257] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.359555] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.359555] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.359704] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.359834] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.360773] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.360773] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.360773] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.360773] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.360773] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.360773] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dea54fa-53b9-4eb3-a0a7-ce06500a230a is going to be updated. [ 792.394895] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e in Status: SUCCESS [ 792.394895] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e deletion is rescheduled due to dependency. [ 792.395065] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.396549] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.396549] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.396549] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.396549] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.396994] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.407204] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dea54fa-53b9-4eb3-a0a7-ce06500a230a in Status: IN_PROGRESS for 2s [ 793.259472] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cef82843-870a-4b3f-b81f-86da463af87e in Status: SUCCESS [ 793.259472] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cef82843-870a-4b3f-b81f-86da463af87e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.420035] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dea54fa-53b9-4eb3-a0a7-ce06500a230a in Status: SUCCESS [ 794.420437] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dea54fa-53b9-4eb3-a0a7-ce06500a230a deletion is rescheduled due to dependency. [ 794.420437] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dea54fa-53b9-4eb3-a0a7-ce06500a230a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.853259] env[65471]: INFO networking_nsxv3.common.synchronization [None req-1d09c2e7-589a-4c70-bd95-d8d04dee7669 None None] Enqueued Resource ID: 83d15565-4599-4917-b77e-eb995e1a863b with Priority: HIGHEST for action port [ 794.853731] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83d15565-4599-4917-b77e-eb995e1a863b with Priority: HIGHEST for action port [ 794.854073] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-83d15565-4599-4917-b77e-eb995e1a863b taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.854205] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-83d15565-4599-4917-b77e-eb995e1a863b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.854336] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-83d15565-4599-4917-b77e-eb995e1a863b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.854514] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-83d15565-4599-4917-b77e-eb995e1a863b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.854595] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83d15565-4599-4917-b77e-eb995e1a863b',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.224855] env[65471]: INFO networking_nsxv3.common.synchronization [None req-21081997-2e9e-4d19-84a6-3e472c1ee62d None None] Enqueued Resource ID: d12ec8a7-0d65-4853-9e88-e015495da767 with Priority: HIGHEST for action port [ 795.227360] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d12ec8a7-0d65-4853-9e88-e015495da767 with Priority: HIGHEST for action port [ 795.227360] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-d12ec8a7-0d65-4853-9e88-e015495da767 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.227360] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d12ec8a7-0d65-4853-9e88-e015495da767" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.227360] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d12ec8a7-0d65-4853-9e88-e015495da767" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.227360] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d12ec8a7-0d65-4853-9e88-e015495da767" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.227360] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d12ec8a7-0d65-4853-9e88-e015495da767',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.361014] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 83d15565-4599-4917-b77e-eb995e1a863b [ 795.361433] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.361433] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.362779] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.362779] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.362779] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.362779] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:83d15565-4599-4917-b77e-eb995e1a863b already deleted. [ 795.363174] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-83d15565-4599-4917-b77e-eb995e1a863b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.728958] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d12ec8a7-0d65-4853-9e88-e015495da767 [ 795.729309] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.729386] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.729445] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.729660] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.729746] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.729840] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d12ec8a7-0d65-4853-9e88-e015495da767 already deleted. [ 795.729919] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d12ec8a7-0d65-4853-9e88-e015495da767" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.853867] env[65471]: INFO networking_nsxv3.common.synchronization [req-5686a796-70f4-4697-9e5a-c26b9aa9196b req-d21f2e23-5bcf-4fa0-a4fe-b8c7f2ecbc56 tempest-ServersWithSpecificFlavorTestJSON-1911677354 tempest-ServersWithSpecificFlavorTestJSON-1911677354-project-member] Enqueued Resource ID: 57387769-3919-42b1-a3d7-3d45bcef516d with Priority: HIGHEST for action security_group_members [ 795.854456] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57387769-3919-42b1-a3d7-3d45bcef516d with Priority: HIGHEST for action security_group_members [ 795.854763] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-57387769-3919-42b1-a3d7-3d45bcef516d taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.854884] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57387769-3919-42b1-a3d7-3d45bcef516d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.854948] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57387769-3919-42b1-a3d7-3d45bcef516d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.855249] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57387769-3919-42b1-a3d7-3d45bcef516d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.855413] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.855515] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.855579] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.856120] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.856120] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.856237] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57387769-3919-42b1-a3d7-3d45bcef516d',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.362017] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.362017] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.362017] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.362017] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.384029] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.384029] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.384029] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.384029] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.384260] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.384260] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.384260] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57387769-3919-42b1-a3d7-3d45bcef516d is going to be updated. [ 796.415198] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.415198] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.415198] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.415198] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.415198] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.424944] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57387769-3919-42b1-a3d7-3d45bcef516d in Status: IN_PROGRESS for 2s [ 796.457665] env[65471]: INFO networking_nsxv3.common.synchronization [req-cd32ebbb-ec59-4733-81ca-80bc0643c629 req-54aca1c9-8ecb-4f8e-be65-bc7db7dbe924 tempest-SecurityGroupsTestJSON-778312627 tempest-SecurityGroupsTestJSON-778312627-project-member] Enqueued Resource ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 with Priority: HIGHEST for action security_group_members [ 796.458232] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 with Priority: HIGHEST for action security_group_members [ 796.458524] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.458678] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.458814] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.458882] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.462484] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.462675] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.462787] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.463113] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.463200] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.463302] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b60bf9ef-6e65-4c6d-87e2-33b6bcafa939',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.844644] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock network-134 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.845025] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "network-134" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.845025] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "network-134" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.845234] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "network-134" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.845487] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.845659] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.846426] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.846683] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.846827] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.847048] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 796.847161] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 796.847265] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 796.847368] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 796.847472] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 796.847571] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 796.847694] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 796.871827] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 796.872429] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 796.872429] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 796.872429] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "network-134" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.872617] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock port-b16a3c90-0195-4cc5-981a-6aadd036abe0 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.872779] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "port-b16a3c90-0195-4cc5-981a-6aadd036abe0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.872891] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "port-b16a3c90-0195-4cc5-981a-6aadd036abe0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.873332] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "port-b16a3c90-0195-4cc5-981a-6aadd036abe0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.873446] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b16a3c90-0195-4cc5-981a-6aadd036abe0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.966867] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b60bf9ef-6e65-4c6d-87e2-33b6bcafa939',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.155815] env[65471]: INFO networking_nsxv3.common.synchronization [None req-2d7c052c-cc52-4f7e-bb0b-bdf5ee43f7fe tempest-ImagesOneServerNegativeTestJSON-124059679 tempest-ImagesOneServerNegativeTestJSON-124059679-project-member] Enqueued Resource ID: c4739b13-b344-4ff7-a2f3-c99365ecbb6b with Priority: HIGHEST for action security_group_rules [ 797.156476] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4739b13-b344-4ff7-a2f3-c99365ecbb6b with Priority: HIGHEST for action security_group_rules [ 797.158113] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c4739b13-b344-4ff7-a2f3-c99365ecbb6b taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.158113] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c4739b13-b344-4ff7-a2f3-c99365ecbb6b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.158113] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c4739b13-b344-4ff7-a2f3-c99365ecbb6b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.158113] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c4739b13-b344-4ff7-a2f3-c99365ecbb6b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.158113] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c4739b13-b344-4ff7-a2f3-c99365ecbb6b',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.256755] env[65471]: INFO networking_nsxv3.common.synchronization [None req-98bec3dd-ba85-4a27-ae7a-475ceed7322c tempest-ImagesOneServerNegativeTestJSON-124059679 tempest-ImagesOneServerNegativeTestJSON-124059679-project-member] Enqueued Resource ID: c4739b13-b344-4ff7-a2f3-c99365ecbb6b with Priority: HIGHEST for action security_group_rules [ 797.256755] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4739b13-b344-4ff7-a2f3-c99365ecbb6b with Priority: HIGHEST for action security_group_rules [ 797.256755] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c4739b13-b344-4ff7-a2f3-c99365ecbb6b taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.256755] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c4739b13-b344-4ff7-a2f3-c99365ecbb6b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.376378] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.376378] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.376527] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.378528] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.378528] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.378528] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Segment Port b16a3c90-0195-4cc5-981a-6aadd036abe0 not found, creating... [ 797.378528] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.378528] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.378528] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.378528] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.378528] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.378528] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.378528] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.378933] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.378933] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.378933] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.378933] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Resource: SegmentPort with ID: b16a3c90-0195-4cc5-981a-6aadd036abe0 is going to be created. [ 797.403223] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.403475] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.403540] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.403838] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.404065] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.404281] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "port-b16a3c90-0195-4cc5-981a-6aadd036abe0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.472239] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b60bf9ef-6e65-4c6d-87e2-33b6bcafa939',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.487980] env[65471]: INFO networking_nsxv3.common.synchronization [None req-5bf7ff3f-959f-442a-b8fe-b8099fc40081 None None] Enqueued Resource ID: 47c60273-92a6-45dc-94b3-3891fb50825c with Priority: HIGHEST for action port [ 797.488872] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47c60273-92a6-45dc-94b3-3891fb50825c with Priority: HIGHEST for action port [ 797.489811] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-47c60273-92a6-45dc-94b3-3891fb50825c taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.489811] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-47c60273-92a6-45dc-94b3-3891fb50825c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.494935] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-47c60273-92a6-45dc-94b3-3891fb50825c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.495122] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-47c60273-92a6-45dc-94b3-3891fb50825c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.495257] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47c60273-92a6-45dc-94b3-3891fb50825c',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.682059] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.682059] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.682059] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.682059] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.682434] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.682434] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c4739b13-b344-4ff7-a2f3-c99365ecbb6b already deleted. [ 797.682434] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c4739b13-b344-4ff7-a2f3-c99365ecbb6b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.682545] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c4739b13-b344-4ff7-a2f3-c99365ecbb6b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.682652] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c4739b13-b344-4ff7-a2f3-c99365ecbb6b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.682732] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c4739b13-b344-4ff7-a2f3-c99365ecbb6b',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.989364] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.989710] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.989710] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.989850] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.989989] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.990473] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 is going to be updated. [ 798.002027] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 47c60273-92a6-45dc-94b3-3891fb50825c [ 798.002318] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.003552] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.003552] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.003552] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.003552] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.003552] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:47c60273-92a6-45dc-94b3-3891fb50825c already deleted. [ 798.003552] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-47c60273-92a6-45dc-94b3-3891fb50825c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.024582] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.024582] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.024582] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.024582] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.024869] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.037070] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 in Status: IN_PROGRESS for 2s [ 798.202736] env[65471]: INFO networking_nsxv3.common.synchronization [req-cd32ebbb-ec59-4733-81ca-80bc0643c629 req-5a4ad34b-4895-409d-a9f4-ab7a59df1699 service nova] Enqueued Resource ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 with Priority: HIGHEST for action security_group_rules [ 798.203395] env[65471]: INFO networking_nsxv3.common.synchronization [req-cd32ebbb-ec59-4733-81ca-80bc0643c629 req-5a4ad34b-4895-409d-a9f4-ab7a59df1699 service nova] Enqueued Resource ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 with Priority: HIGHEST for action security_group_members [ 798.203395] env[65471]: INFO networking_nsxv3.common.synchronization [req-cd32ebbb-ec59-4733-81ca-80bc0643c629 req-5a4ad34b-4895-409d-a9f4-ab7a59df1699 service nova] Enqueued Resource ID: b16a3c90-0195-4cc5-981a-6aadd036abe0 with Priority: HIGHEST for action port [ 798.203872] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 with Priority: HIGHEST for action security_group_rules [ 798.203872] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 with Priority: HIGHEST for action security_group_members [ 798.203872] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b16a3c90-0195-4cc5-981a-6aadd036abe0 with Priority: HIGHEST for action port [ 798.204257] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.204411] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.204498] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.204723] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.204836] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b60bf9ef-6e65-4c6d-87e2-33b6bcafa939',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.205883] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.206035] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.206281] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-b16a3c90-0195-4cc5-981a-6aadd036abe0 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.206432] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b16a3c90-0195-4cc5-981a-6aadd036abe0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.207109] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b16a3c90-0195-4cc5-981a-6aadd036abe0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.207368] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b16a3c90-0195-4cc5-981a-6aadd036abe0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.207440] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b16a3c90-0195-4cc5-981a-6aadd036abe0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.209015] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.209701] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.209701] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.209701] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.209701] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.209701] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c4739b13-b344-4ff7-a2f3-c99365ecbb6b already deleted. [ 798.209701] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c4739b13-b344-4ff7-a2f3-c99365ecbb6b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.437574] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57387769-3919-42b1-a3d7-3d45bcef516d in Status: SUCCESS [ 798.437880] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57387769-3919-42b1-a3d7-3d45bcef516d deletion is rescheduled due to dependency. [ 798.437997] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57387769-3919-42b1-a3d7-3d45bcef516d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.710986] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.711164] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.711402] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b16a3c90-0195-4cc5-981a-6aadd036abe0 with status ACTIVE [ 798.711611] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.711741] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.711847] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.712692] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.712692] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.712692] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.712692] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.712692] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.712692] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.712961] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.712961] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.713974] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.714083] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.716828] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.716828] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.717436] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b16a3c90-0195-4cc5-981a-6aadd036abe0 is going to be updated. [ 798.754599] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.754737] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.754809] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.755046] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.755183] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.755344] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b16a3c90-0195-4cc5-981a-6aadd036abe0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.800268] env[65471]: INFO networking_nsxv3.common.synchronization [req-38ba5ee4-30c1-4f79-ad20-9f7500f64a62 req-b16aaad2-fa52-41c8-ba3f-db1d824e6c5e tempest-AttachInterfacesTestJSON-1197806586 tempest-AttachInterfacesTestJSON-1197806586-project-member] Enqueued Resource ID: 1b605f75-31b8-4209-be69-e1c60e682aa5 with Priority: HIGHEST for action security_group_members [ 798.800938] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b605f75-31b8-4209-be69-e1c60e682aa5 with Priority: HIGHEST for action security_group_members [ 798.801289] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b605f75-31b8-4209-be69-e1c60e682aa5 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.801406] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b605f75-31b8-4209-be69-e1c60e682aa5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.801497] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b605f75-31b8-4209-be69-e1c60e682aa5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.801736] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b605f75-31b8-4209-be69-e1c60e682aa5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.802036] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.802036] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.802165] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.802201] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.802294] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.802417] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b605f75-31b8-4209-be69-e1c60e682aa5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.213843] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock network-238 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.214347] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "network-238" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.214347] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "network-238" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.214751] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "network-238" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.215039] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.215198] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.215342] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.215566] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.215799] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.215963] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 799.216176] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 799.216288] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 799.216443] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 799.216558] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 799.216658] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 799.216783] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 799.237368] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 799.237578] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 799.237646] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 799.237776] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "network-238" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.238246] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock port-b8278b32-da97-4d58-8d86-0d458a91baf6 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.238389] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "port-b8278b32-da97-4d58-8d86-0d458a91baf6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.238389] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "port-b8278b32-da97-4d58-8d86-0d458a91baf6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.238661] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "port-b8278b32-da97-4d58-8d86-0d458a91baf6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.238818] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8278b32-da97-4d58-8d86-0d458a91baf6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.306624] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.306860] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.306860] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.307533] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.307533] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.308527] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.308688] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.308806] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.309083] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.309248] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.309362] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b605f75-31b8-4209-be69-e1c60e682aa5 already deleted. [ 799.309472] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b605f75-31b8-4209-be69-e1c60e682aa5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.373718] env[65471]: INFO networking_nsxv3.common.synchronization [None req-158f9ef7-e320-4bcd-bab5-c1f2867e8d7b None None] Enqueued Resource ID: e317cbce-3a74-4b15-a112-d5f87e96c28c with Priority: HIGHEST for action port [ 799.374420] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e317cbce-3a74-4b15-a112-d5f87e96c28c with Priority: HIGHEST for action port [ 799.374641] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-e317cbce-3a74-4b15-a112-d5f87e96c28c taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.375489] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e317cbce-3a74-4b15-a112-d5f87e96c28c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.375489] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e317cbce-3a74-4b15-a112-d5f87e96c28c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.375489] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e317cbce-3a74-4b15-a112-d5f87e96c28c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.375489] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e317cbce-3a74-4b15-a112-d5f87e96c28c',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.741262] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.741483] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.741605] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.741972] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.742129] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.742279] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Segment Port b8278b32-da97-4d58-8d86-0d458a91baf6 not found, creating... [ 799.742603] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.742698] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.742780] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.743014] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.743163] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.743416] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.743558] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.743668] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.743924] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.743987] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.744111] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Resource: SegmentPort with ID: b8278b32-da97-4d58-8d86-0d458a91baf6 is going to be created. [ 799.766786] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.766993] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.767100] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.767405] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.767677] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.767935] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "port-b8278b32-da97-4d58-8d86-0d458a91baf6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.877619] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e317cbce-3a74-4b15-a112-d5f87e96c28c [ 799.877919] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.878095] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.878169] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.878422] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.878538] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.878638] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e317cbce-3a74-4b15-a112-d5f87e96c28c already deleted. [ 799.878722] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e317cbce-3a74-4b15-a112-d5f87e96c28c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.048593] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 in Status: SUCCESS [ 800.048902] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.049136] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.049419] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.049665] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.049820] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.049955] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.050090] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.050235] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.050338] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b60bf9ef-6e65-4c6d-87e2-33b6bcafa939',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.510135] env[65471]: INFO networking_nsxv3.common.synchronization [req-38ba5ee4-30c1-4f79-ad20-9f7500f64a62 req-6badbb16-6f92-400f-a2de-713706ad3272 service nova] Enqueued Resource ID: 1b605f75-31b8-4209-be69-e1c60e682aa5 with Priority: HIGHEST for action security_group_rules [ 800.510393] env[65471]: INFO networking_nsxv3.common.synchronization [req-38ba5ee4-30c1-4f79-ad20-9f7500f64a62 req-6badbb16-6f92-400f-a2de-713706ad3272 service nova] Enqueued Resource ID: 1b605f75-31b8-4209-be69-e1c60e682aa5 with Priority: HIGHEST for action security_group_members [ 800.510508] env[65471]: INFO networking_nsxv3.common.synchronization [req-38ba5ee4-30c1-4f79-ad20-9f7500f64a62 req-6badbb16-6f92-400f-a2de-713706ad3272 service nova] Enqueued Resource ID: b8278b32-da97-4d58-8d86-0d458a91baf6 with Priority: HIGHEST for action port [ 800.511076] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b605f75-31b8-4209-be69-e1c60e682aa5 with Priority: HIGHEST for action security_group_rules [ 800.511209] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b605f75-31b8-4209-be69-e1c60e682aa5 with Priority: HIGHEST for action security_group_members [ 800.511305] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8278b32-da97-4d58-8d86-0d458a91baf6 with Priority: HIGHEST for action port [ 800.511572] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1b605f75-31b8-4209-be69-e1c60e682aa5 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.511687] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1b605f75-31b8-4209-be69-e1c60e682aa5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.511750] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1b605f75-31b8-4209-be69-e1c60e682aa5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.511952] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1b605f75-31b8-4209-be69-e1c60e682aa5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.512294] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1b605f75-31b8-4209-be69-e1c60e682aa5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.513228] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b605f75-31b8-4209-be69-e1c60e682aa5 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.513342] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b605f75-31b8-4209-be69-e1c60e682aa5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.513414] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b605f75-31b8-4209-be69-e1c60e682aa5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.513629] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b605f75-31b8-4209-be69-e1c60e682aa5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.513918] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.514170] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.514251] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.514422] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.514507] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.514599] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b605f75-31b8-4209-be69-e1c60e682aa5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.515375] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-b8278b32-da97-4d58-8d86-0d458a91baf6 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.515812] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b8278b32-da97-4d58-8d86-0d458a91baf6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.515905] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b8278b32-da97-4d58-8d86-0d458a91baf6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.516108] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b8278b32-da97-4d58-8d86-0d458a91baf6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.516189] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8278b32-da97-4d58-8d86-0d458a91baf6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.552848] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b60bf9ef-6e65-4c6d-87e2-33b6bcafa939',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.768030] env[65471]: INFO networking_nsxv3.common.synchronization [req-7c61dd46-06d6-4ac7-aa82-b01a7b3a282a req-858e225d-de84-48e2-9825-7d96d4b85002 tempest-ServerDiagnosticsNegativeTest-241749810 tempest-ServerDiagnosticsNegativeTest-241749810-project-member] Enqueued Resource ID: cef82843-870a-4b3f-b81f-86da463af87e with Priority: HIGHEST for action security_group_members [ 800.768620] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cef82843-870a-4b3f-b81f-86da463af87e with Priority: HIGHEST for action security_group_members [ 800.768964] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-cef82843-870a-4b3f-b81f-86da463af87e taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.771112] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cef82843-870a-4b3f-b81f-86da463af87e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.771112] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cef82843-870a-4b3f-b81f-86da463af87e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.771112] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cef82843-870a-4b3f-b81f-86da463af87e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.771112] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.771112] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.771112] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.771379] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.771493] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.771582] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cef82843-870a-4b3f-b81f-86da463af87e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.017890] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1b605f75-31b8-4209-be69-e1c60e682aa5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.019064] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b605f75-31b8-4209-be69-e1c60e682aa5 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.019179] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b605f75-31b8-4209-be69-e1c60e682aa5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.019369] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b8278b32-da97-4d58-8d86-0d458a91baf6 with status ACTIVE [ 801.020742] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.020984] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.021079] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.021271] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.022251] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.022251] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.022251] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.022251] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.022251] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.025049] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.025577] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.025577] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.025577] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.025858] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.025858] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.026601] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b8278b32-da97-4d58-8d86-0d458a91baf6 is going to be updated. [ 801.053429] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.053765] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.053765] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.054066] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.054066] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.054246] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b8278b32-da97-4d58-8d86-0d458a91baf6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.057165] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b60bf9ef-6e65-4c6d-87e2-33b6bcafa939',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.281608] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.281608] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.281608] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.281608] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.281608] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.281608] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.281608] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.281608] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.282378] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.282378] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.282378] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cef82843-870a-4b3f-b81f-86da463af87e is going to be updated. [ 801.315533] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.315702] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.315745] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.315986] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.316163] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.326692] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cef82843-870a-4b3f-b81f-86da463af87e in Status: IN_PROGRESS for 2s [ 801.508977] env[65471]: INFO networking_nsxv3.common.synchronization [req-158e3436-f5c3-451e-b830-02f8a368d9b2 req-ef594743-06ad-49e8-a0a0-28909063fca3 tempest-ImagesTestJSON-650286870 tempest-ImagesTestJSON-650286870-project-member] Enqueued Resource ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f with Priority: HIGHEST for action security_group_members [ 801.509779] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f with Priority: HIGHEST for action security_group_members [ 801.510438] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-85af6c5e-2f9b-491d-9584-96c44b20f99f taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.510718] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.510718] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.511323] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.514413] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.514413] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.514413] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.514413] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.514413] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.514413] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85af6c5e-2f9b-491d-9584-96c44b20f99f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.528576] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1b605f75-31b8-4209-be69-e1c60e682aa5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.560615] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.563072] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.563072] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.563072] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.563072] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.563072] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 is going to be updated. [ 801.605449] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.605642] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.605712] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.605931] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.606098] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.625933] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 in Status: IN_PROGRESS for 2s [ 802.016996] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.017155] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.017250] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.017493] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.017584] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.017893] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.017948] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.017988] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.018160] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.018238] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.018698] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f is going to be updated. [ 802.032096] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock network-235 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.032421] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "network-235" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.032924] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "network-235" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.032924] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "network-235" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.033238] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.033406] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.033542] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.033796] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.033953] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.034199] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 802.034324] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 802.034447] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 802.034852] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 802.034852] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 802.034852] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 802.035030] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 802.036397] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.036512] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.036600] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.036779] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.036916] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.036970] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b605f75-31b8-4209-be69-e1c60e682aa5 is going to be created. [ 802.066238] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.066379] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.066878] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.066878] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.067069] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.069099] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 802.069490] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 802.069490] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 802.069704] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "network-235" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.070176] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock port-9b43616a-207d-4cbd-b789-16684b83cd0c taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.070621] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "port-9b43616a-207d-4cbd-b789-16684b83cd0c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.070621] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "port-9b43616a-207d-4cbd-b789-16684b83cd0c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.070831] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "port-9b43616a-207d-4cbd-b789-16684b83cd0c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.071177] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b43616a-207d-4cbd-b789-16684b83cd0c',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.080602] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.080602] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.080602] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.080602] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.080602] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.082788] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f in Status: IN_PROGRESS for 2s [ 802.087839] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b605f75-31b8-4209-be69-e1c60e682aa5 in Status: UNINITIALIZED for 2s [ 802.574294] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.574597] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.574701] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.574986] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.575242] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.575409] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Segment Port 9b43616a-207d-4cbd-b789-16684b83cd0c not found, creating... [ 802.575694] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.575867] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.576011] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.576259] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.576416] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.576698] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.576865] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.576985] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.577223] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.577371] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.577525] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Resource: SegmentPort with ID: 9b43616a-207d-4cbd-b789-16684b83cd0c is going to be created. [ 802.603547] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.603754] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.603919] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.604329] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.604669] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.604913] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "port-9b43616a-207d-4cbd-b789-16684b83cd0c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.338025] env[65471]: INFO networking_nsxv3.common.synchronization [req-158e3436-f5c3-451e-b830-02f8a368d9b2 req-36e0c860-92f9-48f8-b5fc-5bde1bc2f800 service nova] Enqueued Resource ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f with Priority: HIGHEST for action security_group_rules [ 803.338122] env[65471]: INFO networking_nsxv3.common.synchronization [req-158e3436-f5c3-451e-b830-02f8a368d9b2 req-36e0c860-92f9-48f8-b5fc-5bde1bc2f800 service nova] Enqueued Resource ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f with Priority: HIGHEST for action security_group_members [ 803.338250] env[65471]: INFO networking_nsxv3.common.synchronization [req-158e3436-f5c3-451e-b830-02f8a368d9b2 req-36e0c860-92f9-48f8-b5fc-5bde1bc2f800 service nova] Enqueued Resource ID: 9b43616a-207d-4cbd-b789-16684b83cd0c with Priority: HIGHEST for action port [ 803.339217] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f with Priority: HIGHEST for action security_group_rules [ 803.339395] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f with Priority: HIGHEST for action security_group_members [ 803.339523] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b43616a-207d-4cbd-b789-16684b83cd0c with Priority: HIGHEST for action port [ 803.340484] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cef82843-870a-4b3f-b81f-86da463af87e in Status: SUCCESS [ 803.340672] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cef82843-870a-4b3f-b81f-86da463af87e deletion is rescheduled due to dependency. [ 803.340773] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cef82843-870a-4b3f-b81f-86da463af87e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.341130] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85af6c5e-2f9b-491d-9584-96c44b20f99f taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.341265] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.341331] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.341606] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.341667] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85af6c5e-2f9b-491d-9584-96c44b20f99f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.343352] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-85af6c5e-2f9b-491d-9584-96c44b20f99f taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.343564] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.343807] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-9b43616a-207d-4cbd-b789-16684b83cd0c taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.343918] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9b43616a-207d-4cbd-b789-16684b83cd0c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.343987] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9b43616a-207d-4cbd-b789-16684b83cd0c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.344185] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9b43616a-207d-4cbd-b789-16684b83cd0c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.344263] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b43616a-207d-4cbd-b789-16684b83cd0c',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.389474] env[65471]: INFO networking_nsxv3.common.synchronization [req-e3e3a4d6-d1c5-4d0f-8a4f-af7ea9f65f38 req-f5383894-2b94-42fa-a590-59ebc339160f tempest-VolumesAssistedSnapshotsTest-1042800714 tempest-VolumesAssistedSnapshotsTest-1042800714-project-member] Enqueued Resource ID: aa46e0ea-568f-4c50-a725-6d162fee238a with Priority: HIGHEST for action security_group_members [ 803.389952] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa46e0ea-568f-4c50-a725-6d162fee238a with Priority: HIGHEST for action security_group_members [ 803.390287] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa46e0ea-568f-4c50-a725-6d162fee238a taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.390415] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa46e0ea-568f-4c50-a725-6d162fee238a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.390481] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa46e0ea-568f-4c50-a725-6d162fee238a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.390680] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa46e0ea-568f-4c50-a725-6d162fee238a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.390870] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.390966] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.391024] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.391184] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.391266] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.391363] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa46e0ea-568f-4c50-a725-6d162fee238a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.638080] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 in Status: SUCCESS [ 803.638464] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.639104] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.639408] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.639723] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.640428] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.641108] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.641108] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.641108] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.641252] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.641341] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b60bf9ef-6e65-4c6d-87e2-33b6bcafa939',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.844535] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-85af6c5e-2f9b-491d-9584-96c44b20f99f taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.844535] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.847110] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9b43616a-207d-4cbd-b789-16684b83cd0c with status ACTIVE [ 803.847110] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.847110] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.847110] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.847110] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.847110] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.847110] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.847110] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.847907] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.847907] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.847907] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.847907] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.847907] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.847907] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.847907] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.848413] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.848413] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9b43616a-207d-4cbd-b789-16684b83cd0c is going to be updated. [ 803.874889] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.874889] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.874889] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.875134] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.875209] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.875429] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9b43616a-207d-4cbd-b789-16684b83cd0c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.896422] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.896422] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.896422] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.896422] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.941212] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.942134] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.942134] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.942134] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.942134] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.942134] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.942414] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa46e0ea-568f-4c50-a725-6d162fee238a is going to be updated. [ 804.002184] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.002419] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.002419] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.002733] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.002890] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.022026] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa46e0ea-568f-4c50-a725-6d162fee238a in Status: IN_PROGRESS for 2s [ 804.096437] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f in Status: SUCCESS [ 804.096437] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f deletion is rescheduled due to dependency. [ 804.096437] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.096746] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.097150] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.097744] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.097744] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.097744] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.098220] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.098220] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.098220] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85af6c5e-2f9b-491d-9584-96c44b20f99f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.107158] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b605f75-31b8-4209-be69-e1c60e682aa5 in Status: SUCCESS [ 804.107710] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b605f75-31b8-4209-be69-e1c60e682aa5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.107892] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b605f75-31b8-4209-be69-e1c60e682aa5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.108105] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b605f75-31b8-4209-be69-e1c60e682aa5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.108342] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.108491] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.108566] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.108714] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.109541] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.109706] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b605f75-31b8-4209-be69-e1c60e682aa5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.109828] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1b605f75-31b8-4209-be69-e1c60e682aa5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.143842] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.143842] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.144222] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.144222] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.144322] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.144432] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.144497] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.144664] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.144764] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.144906] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.145051] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.145150] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.145210] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.145359] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.145499] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.145622] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.145666] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.145777] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.145858] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.146055] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.146106] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b60bf9ef-6e65-4c6d-87e2-33b6bcafa939',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.601049] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('85af6c5e-2f9b-491d-9584-96c44b20f99f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.612307] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1b605f75-31b8-4209-be69-e1c60e682aa5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.649108] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b60bf9ef-6e65-4c6d-87e2-33b6bcafa939: rpc.has_security_group_logging(os_id): False [ 804.669744] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.669951] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.669951] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.670188] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.670279] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.670493] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.670595] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.670657] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.670881] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.671310] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.671310] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.671441] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.671441] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.671528] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.671625] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.671892] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.672012] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.672012] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.672135] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.672249] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.672306] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 is going to be updated. [ 804.759583] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.759583] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.759583] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.759948] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.759948] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.791144] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 in Status: IN_PROGRESS for 2s [ 804.806241] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.806402] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.806472] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.807033] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.807033] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.105665] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('85af6c5e-2f9b-491d-9584-96c44b20f99f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.114450] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1b605f75-31b8-4209-be69-e1c60e682aa5: rpc.has_security_group_logging(os_id): False [ 805.134153] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.135153] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.135323] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.135584] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.135708] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.136046] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.136223] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.137418] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.137418] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.137418] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.137418] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b605f75-31b8-4209-be69-e1c60e682aa5 is going to be created. [ 805.206959] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.206959] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.206959] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.206959] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.206959] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.222082] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1b605f75-31b8-4209-be69-e1c60e682aa5 in Status: IN_PROGRESS for 2s [ 805.309625] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.607719] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.607949] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.608099] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.608348] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.608504] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.608651] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f is going to be updated. [ 805.643052] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.643130] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.643195] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.643402] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.643601] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.654738] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f in Status: IN_PROGRESS for 2s [ 805.812600] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.034140] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa46e0ea-568f-4c50-a725-6d162fee238a in Status: SUCCESS [ 806.034340] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa46e0ea-568f-4c50-a725-6d162fee238a deletion is rescheduled due to dependency. [ 806.034552] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa46e0ea-568f-4c50-a725-6d162fee238a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.315675] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 806.315789] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 806.332976] env[65471]: INFO networking_nsxv3.common.synchronization [req-aa625b73-be9b-402a-a059-ad1524d9d290 req-4a93a216-0b6b-4644-a340-8b0e6a87e294 tempest-ServersTestJSON-2129330820 tempest-ServersTestJSON-2129330820-project-member] Enqueued Resource ID: 9164de2f-6b7d-4419-aa70-d088a6c9ab9f with Priority: HIGHEST for action security_group_members [ 806.333502] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9164de2f-6b7d-4419-aa70-d088a6c9ab9f with Priority: HIGHEST for action security_group_members [ 806.333812] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-9164de2f-6b7d-4419-aa70-d088a6c9ab9f taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.333946] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9164de2f-6b7d-4419-aa70-d088a6c9ab9f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.334040] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9164de2f-6b7d-4419-aa70-d088a6c9ab9f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.334237] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9164de2f-6b7d-4419-aa70-d088a6c9ab9f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.334399] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.334489] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.334621] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.334698] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.334788] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.334882] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9164de2f-6b7d-4419-aa70-d088a6c9ab9f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.814499] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 in Status: SUCCESS [ 806.814964] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.837856] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.838068] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.838295] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.838435] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.867318] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.867651] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.867787] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.867882] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.868069] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.868160] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.868251] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9164de2f-6b7d-4419-aa70-d088a6c9ab9f is going to be updated. [ 806.898229] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.898427] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.898427] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.898638] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.898791] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.908490] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9164de2f-6b7d-4419-aa70-d088a6c9ab9f in Status: IN_PROGRESS for 2s [ 806.960193] env[65471]: INFO networking_nsxv3.common.synchronization [req-e4fead00-df8b-4880-8086-a510a47ebd23 req-e6a9c8a2-df28-404c-b2e8-b655131f2d36 tempest-MigrationsAdminTest-433965692 tempest-MigrationsAdminTest-433965692-project-member] Enqueued Resource ID: 2ecf6012-bc6c-4512-8d9d-962c10f0cad9 with Priority: HIGHEST for action security_group_members [ 806.960797] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ecf6012-bc6c-4512-8d9d-962c10f0cad9 with Priority: HIGHEST for action security_group_members [ 806.961173] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.961289] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.961351] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.961595] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.961711] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.961813] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.961876] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.966375] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.966375] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.966375] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ecf6012-bc6c-4512-8d9d-962c10f0cad9',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.239700] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1b605f75-31b8-4209-be69-e1c60e682aa5 in Status: SUCCESS [ 807.239949] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1b605f75-31b8-4209-be69-e1c60e682aa5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.353156] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.353343] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.355611] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.355611] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.367640] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 807.368575] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.369436] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 807.402729] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.402729] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.402729] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.402993] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.410982] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.411520] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 807.411600] env[65471]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65471) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 807.411688] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 807.455830] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.456023] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.456086] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.456312] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.457555] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.457733] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 807.467291] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2ecf6012-bc6c-4512-8d9d-962c10f0cad9',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.529384] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.529528] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.529598] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.530248] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.530511] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.530820] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 807.612364] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.612697] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.612697] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.613043] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.613321] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.613698] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:38. [ 807.613861] env[65471]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'a3c5f688-9271-4722-84e9-69667c674933', 'fc157df5-294c-4a29-82ae-e1ec842611f3', 'b60bf9ef-6e65-4c6d-87e2-33b6bcafa939', '9164de2f-6b7d-4419-aa70-d088a6c9ab9f', '15cae89a-6005-4f02-95eb-d04ef2f8ea8e', 'cd8e3453-8620-4f9d-b764-155e97a20205', '2ecf6012-bc6c-4512-8d9d-962c10f0cad9', 'f7dafcbc-15be-4704-ad92-28657ead70aa', 'e4ca8456-5b21-4080-b762-7b52a4837eb1', 'ceb1afc4-63ef-450a-b72c-5b79e8970a01', '2701e2a3-bfcb-431d-b91c-91e91e5af6e1', 'cef82843-870a-4b3f-b81f-86da463af87e', '453acdc6-7d50-452b-bb4b-66af12a7624a', '0dea54fa-53b9-4eb3-a0a7-ce06500a230a', 'ca7195fd-265e-439f-ac03-4bb1a006981b', '49f0917b-c43e-421e-9ccf-fe8487bf2b37', '44e07836-d56c-494a-9b74-978c8fd6933f', 'aa1e565f-d426-4783-ad96-ca42d167f6b8', 'ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a', 'aa46e0ea-568f-4c50-a725-6d162fee238a', '401f7079-c4c2-4951-b6ae-bc1cfbb23228', '58316ca3-525d-4197-969c-1e363b6969c6', '57387769-3919-42b1-a3d7-3d45bcef516d', 'b71ce0e0-83fe-4f36-8617-e29f83b0be32', '2a9f3871-1bad-4130-b669-97b85ced692d', '7cefc497-117e-45da-bc1f-1ab0ea166d74', '69a8cc18-3d2c-4522-9688-4b5525d659e0', 'ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46', '14a38584-d8ef-4361-b344-b91e376144fa', 'bbd99ac4-1db4-4ccf-af90-c6ef33212f88', 'a976012d-6558-47ff-8d35-cffeac52b05f', '76ee3a37-4552-4528-8f6c-448ca2d9b094', '927a7ac0-117d-4551-a979-a43f61af6c25', '1b605f75-31b8-4209-be69-e1c60e682aa5', '50c2c28e-c8d2-4f9e-a431-6df336da2df5', 'b04574ca-6910-4de6-a76c-d7d90c7e2e0c', '1c8a6eda-c0ec-4e25-8652-6acf3d57da4e', '85af6c5e-2f9b-491d-9584-96c44b20f99f'} {{(pid=65471) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 807.613994] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 807.634526] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.638022] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.638022] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.638022] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.638022] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.638022] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 807.638022] env[65471]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65471) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 807.638022] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 807.671211] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f in Status: SUCCESS [ 807.671211] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.671211] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.671211] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.671211] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.671211] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.671211] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.671211] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.671211] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.671211] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.671211] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('85af6c5e-2f9b-491d-9584-96c44b20f99f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.675704] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock network-647 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.677374] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "network-647" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.677374] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "network-647" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.677374] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "network-647" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.677578] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.679025] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.679025] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.679025] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.679025] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.679025] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 807.679025] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 807.679025] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 807.679025] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 807.679025] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 807.679719] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 807.680019] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 807.701402] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 807.701586] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 807.701753] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 807.702009] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "network-647" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.702376] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock port-912d405e-34fe-4d96-ab65-70475e22f599 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.702590] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "port-912d405e-34fe-4d96-ab65-70475e22f599" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.702722] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "port-912d405e-34fe-4d96-ab65-70475e22f599" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.703081] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "port-912d405e-34fe-4d96-ab65-70475e22f599" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.703598] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('912d405e-34fe-4d96-ab65-70475e22f599',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.723630] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.723630] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.723853] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.723978] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.725049] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.725486] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 807.725486] env[65471]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65471) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 807.725581] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 807.725612] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 807.725869] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/38 resources of Type:Security Group Rules [ 807.725958] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a3c5f688-9271-4722-84e9-69667c674933 with Priority: HIGH for action security_group_rules [ 807.726062] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fc157df5-294c-4a29-82ae-e1ec842611f3 with Priority: HIGH for action security_group_rules [ 807.726176] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 with Priority: HIGH for action security_group_rules [ 807.726262] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9164de2f-6b7d-4419-aa70-d088a6c9ab9f with Priority: HIGH for action security_group_rules [ 807.726339] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 15cae89a-6005-4f02-95eb-d04ef2f8ea8e with Priority: HIGH for action security_group_rules [ 807.726425] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cd8e3453-8620-4f9d-b764-155e97a20205 with Priority: HIGH for action security_group_rules [ 807.726531] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2ecf6012-bc6c-4512-8d9d-962c10f0cad9 with Priority: HIGH for action security_group_rules [ 807.726603] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f7dafcbc-15be-4704-ad92-28657ead70aa with Priority: HIGH for action security_group_rules [ 807.726689] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 with Priority: HIGH for action security_group_rules [ 807.726738] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ceb1afc4-63ef-450a-b72c-5b79e8970a01 with Priority: HIGH for action security_group_rules [ 807.726780] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2701e2a3-bfcb-431d-b91c-91e91e5af6e1 with Priority: HIGH for action security_group_rules [ 807.726861] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cef82843-870a-4b3f-b81f-86da463af87e with Priority: HIGH for action security_group_rules [ 807.726908] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 453acdc6-7d50-452b-bb4b-66af12a7624a with Priority: HIGH for action security_group_rules [ 807.726953] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0dea54fa-53b9-4eb3-a0a7-ce06500a230a with Priority: HIGH for action security_group_rules [ 807.727082] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ca7195fd-265e-439f-ac03-4bb1a006981b with Priority: HIGH for action security_group_rules [ 807.727162] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 49f0917b-c43e-421e-9ccf-fe8487bf2b37 with Priority: HIGH for action security_group_rules [ 807.727226] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 44e07836-d56c-494a-9b74-978c8fd6933f with Priority: HIGH for action security_group_rules [ 807.727287] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: aa1e565f-d426-4783-ad96-ca42d167f6b8 with Priority: HIGH for action security_group_rules [ 807.727350] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a with Priority: HIGH for action security_group_rules [ 807.727412] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: aa46e0ea-568f-4c50-a725-6d162fee238a with Priority: HIGH for action security_group_rules [ 807.727511] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.968974] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2ecf6012-bc6c-4512-8d9d-962c10f0cad9',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.172969] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-85af6c5e-2f9b-491d-9584-96c44b20f99f taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.173354] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.173354] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.173489] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.175469] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.175469] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.175469] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.175469] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.175469] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.175469] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.175469] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-85af6c5e-2f9b-491d-9584-96c44b20f99f taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.175469] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.175469] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.175469] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.175469] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.175469] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.175469] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.175469] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.175469] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.176978] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.176978] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('85af6c5e-2f9b-491d-9584-96c44b20f99f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.206469] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.206780] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.206853] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.207123] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.207267] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.207425] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Segment Port 912d405e-34fe-4d96-ab65-70475e22f599 not found, creating... [ 808.207691] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.207850] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.207961] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.208246] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.208353] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.208629] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.208778] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.208888] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.209172] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.209306] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.209439] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Resource: SegmentPort with ID: 912d405e-34fe-4d96-ab65-70475e22f599 is going to be created. [ 808.236951] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.238029] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.238029] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.238029] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.238189] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.238414] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "port-912d405e-34fe-4d96-ab65-70475e22f599" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.335209] env[65471]: INFO networking_nsxv3.common.synchronization [None req-8335c335-ac21-49a3-9b06-ae33f347f68e None None] Enqueued Resource ID: c544d660-c0af-48e3-b574-f1b1bd998633 with Priority: HIGHEST for action port [ 808.335850] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c544d660-c0af-48e3-b574-f1b1bd998633 with Priority: HIGHEST for action port [ 808.337768] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3c5f688-9271-4722-84e9-69667c674933 with Priority: HIGH for action security_group_rules [ 808.341026] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 with Priority: HIGH for action security_group_rules [ 808.341026] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ecf6012-bc6c-4512-8d9d-962c10f0cad9 with Priority: HIGH for action security_group_rules [ 808.341026] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca7195fd-265e-439f-ac03-4bb1a006981b with Priority: HIGH for action security_group_rules [ 808.341026] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa46e0ea-568f-4c50-a725-6d162fee238a with Priority: HIGH for action security_group_rules [ 808.341026] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a with Priority: HIGH for action security_group_rules [ 808.341026] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa1e565f-d426-4783-ad96-ca42d167f6b8 with Priority: HIGH for action security_group_rules [ 808.341026] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44e07836-d56c-494a-9b74-978c8fd6933f with Priority: HIGH for action security_group_rules [ 808.341026] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dea54fa-53b9-4eb3-a0a7-ce06500a230a with Priority: HIGH for action security_group_rules [ 808.341026] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49f0917b-c43e-421e-9ccf-fe8487bf2b37 with Priority: HIGH for action security_group_rules [ 808.341026] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 453acdc6-7d50-452b-bb4b-66af12a7624a with Priority: HIGH for action security_group_rules [ 808.341026] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cef82843-870a-4b3f-b81f-86da463af87e with Priority: HIGH for action security_group_rules [ 808.341026] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2701e2a3-bfcb-431d-b91c-91e91e5af6e1 with Priority: HIGH for action security_group_rules [ 808.341026] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ceb1afc4-63ef-450a-b72c-5b79e8970a01 with Priority: HIGH for action security_group_rules [ 808.341026] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 with Priority: HIGH for action security_group_rules [ 808.341026] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd8e3453-8620-4f9d-b764-155e97a20205 with Priority: HIGH for action security_group_rules [ 808.341026] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7dafcbc-15be-4704-ad92-28657ead70aa with Priority: HIGH for action security_group_rules [ 808.341026] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15cae89a-6005-4f02-95eb-d04ef2f8ea8e with Priority: HIGH for action security_group_rules [ 808.341026] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc157df5-294c-4a29-82ae-e1ec842611f3 with Priority: HIGH for action security_group_rules [ 808.341026] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9164de2f-6b7d-4419-aa70-d088a6c9ab9f with Priority: HIGH for action security_group_rules [ 808.341026] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-c544d660-c0af-48e3-b574-f1b1bd998633 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.341026] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c544d660-c0af-48e3-b574-f1b1bd998633" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.341026] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c544d660-c0af-48e3-b574-f1b1bd998633" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.341026] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c544d660-c0af-48e3-b574-f1b1bd998633" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.341026] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c544d660-c0af-48e3-b574-f1b1bd998633',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.342088] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a3c5f688-9271-4722-84e9-69667c674933 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.342224] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.342344] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.342536] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.342620] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a3c5f688-9271-4722-84e9-69667c674933',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.343848] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.343999] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.345776] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.345776] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.345776] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b60bf9ef-6e65-4c6d-87e2-33b6bcafa939',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.348800] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ecf6012-bc6c-4512-8d9d-962c10f0cad9 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.348800] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.348800] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.348800] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.348800] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ecf6012-bc6c-4512-8d9d-962c10f0cad9',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.349203] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca7195fd-265e-439f-ac03-4bb1a006981b taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.349358] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca7195fd-265e-439f-ac03-4bb1a006981b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.349358] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca7195fd-265e-439f-ac03-4bb1a006981b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.349516] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca7195fd-265e-439f-ac03-4bb1a006981b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.349590] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca7195fd-265e-439f-ac03-4bb1a006981b',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.350764] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa46e0ea-568f-4c50-a725-6d162fee238a taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.350958] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa46e0ea-568f-4c50-a725-6d162fee238a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.351081] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa46e0ea-568f-4c50-a725-6d162fee238a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.351226] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa46e0ea-568f-4c50-a725-6d162fee238a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.351402] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa46e0ea-568f-4c50-a725-6d162fee238a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.352373] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.352479] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.352542] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.352703] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.352796] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.354223] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa1e565f-d426-4783-ad96-ca42d167f6b8 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.354223] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa1e565f-d426-4783-ad96-ca42d167f6b8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.354223] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa1e565f-d426-4783-ad96-ca42d167f6b8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.354423] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa1e565f-d426-4783-ad96-ca42d167f6b8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.354423] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa1e565f-d426-4783-ad96-ca42d167f6b8',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.355239] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-44e07836-d56c-494a-9b74-978c8fd6933f taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.355364] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-44e07836-d56c-494a-9b74-978c8fd6933f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.355412] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-44e07836-d56c-494a-9b74-978c8fd6933f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.355584] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-44e07836-d56c-494a-9b74-978c8fd6933f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.355710] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('44e07836-d56c-494a-9b74-978c8fd6933f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.355921] env[65471]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 808.356717] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0dea54fa-53b9-4eb3-a0a7-ce06500a230a taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.356852] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0dea54fa-53b9-4eb3-a0a7-ce06500a230a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.356933] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0dea54fa-53b9-4eb3-a0a7-ce06500a230a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.357106] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0dea54fa-53b9-4eb3-a0a7-ce06500a230a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.357181] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0dea54fa-53b9-4eb3-a0a7-ce06500a230a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.358248] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49f0917b-c43e-421e-9ccf-fe8487bf2b37 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.358560] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49f0917b-c43e-421e-9ccf-fe8487bf2b37" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.358560] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49f0917b-c43e-421e-9ccf-fe8487bf2b37" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.358560] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49f0917b-c43e-421e-9ccf-fe8487bf2b37" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.358666] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49f0917b-c43e-421e-9ccf-fe8487bf2b37',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.359678] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-453acdc6-7d50-452b-bb4b-66af12a7624a taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.359863] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-453acdc6-7d50-452b-bb4b-66af12a7624a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.359863] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-453acdc6-7d50-452b-bb4b-66af12a7624a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.360011] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-453acdc6-7d50-452b-bb4b-66af12a7624a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.360072] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('453acdc6-7d50-452b-bb4b-66af12a7624a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.361033] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cef82843-870a-4b3f-b81f-86da463af87e taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.361180] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cef82843-870a-4b3f-b81f-86da463af87e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.361223] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cef82843-870a-4b3f-b81f-86da463af87e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.361397] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cef82843-870a-4b3f-b81f-86da463af87e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.361437] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cef82843-870a-4b3f-b81f-86da463af87e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.362566] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2701e2a3-bfcb-431d-b91c-91e91e5af6e1 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.362566] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2701e2a3-bfcb-431d-b91c-91e91e5af6e1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.362848] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2701e2a3-bfcb-431d-b91c-91e91e5af6e1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.362848] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2701e2a3-bfcb-431d-b91c-91e91e5af6e1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.362848] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2701e2a3-bfcb-431d-b91c-91e91e5af6e1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.363745] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ceb1afc4-63ef-450a-b72c-5b79e8970a01 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.363863] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ceb1afc4-63ef-450a-b72c-5b79e8970a01" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.363953] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ceb1afc4-63ef-450a-b72c-5b79e8970a01" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.364495] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ceb1afc4-63ef-450a-b72c-5b79e8970a01" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.364495] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ceb1afc4-63ef-450a-b72c-5b79e8970a01',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.365434] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e4ca8456-5b21-4080-b762-7b52a4837eb1 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.365538] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.365604] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.365767] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.365841] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e4ca8456-5b21-4080-b762-7b52a4837eb1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.366923] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd8e3453-8620-4f9d-b764-155e97a20205 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.367041] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd8e3453-8620-4f9d-b764-155e97a20205" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.367136] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd8e3453-8620-4f9d-b764-155e97a20205" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.367255] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd8e3453-8620-4f9d-b764-155e97a20205" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.367329] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd8e3453-8620-4f9d-b764-155e97a20205',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.368343] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7dafcbc-15be-4704-ad92-28657ead70aa taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.368343] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.368761] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.368761] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.368761] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7dafcbc-15be-4704-ad92-28657ead70aa',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.369583] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15cae89a-6005-4f02-95eb-d04ef2f8ea8e taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.369698] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.369698] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.369912] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.369912] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15cae89a-6005-4f02-95eb-d04ef2f8ea8e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.370159] env[65471]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 808.372864] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fc157df5-294c-4a29-82ae-e1ec842611f3 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.373060] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fc157df5-294c-4a29-82ae-e1ec842611f3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.373060] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fc157df5-294c-4a29-82ae-e1ec842611f3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.373165] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fc157df5-294c-4a29-82ae-e1ec842611f3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.373274] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fc157df5-294c-4a29-82ae-e1ec842611f3',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.374295] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9164de2f-6b7d-4419-aa70-d088a6c9ab9f taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.374453] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9164de2f-6b7d-4419-aa70-d088a6c9ab9f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.374453] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9164de2f-6b7d-4419-aa70-d088a6c9ab9f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.374631] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9164de2f-6b7d-4419-aa70-d088a6c9ab9f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.374705] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9164de2f-6b7d-4419-aa70-d088a6c9ab9f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.380254] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.380669] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.382056] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c544d660-c0af-48e3-b574-f1b1bd998633 [ 808.382292] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.382448] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.382522] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.382756] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.382859] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.382973] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c544d660-c0af-48e3-b574-f1b1bd998633 already deleted. [ 808.383090] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c544d660-c0af-48e3-b574-f1b1bd998633" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.419269] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.419269] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.419269] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.419269] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.446532] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.446689] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a3c5f688-9271-4722-84e9-69667c674933 is going to be deleted. [ 808.471743] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.472124] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.472274] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.472448] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.472538] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.472644] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ecf6012-bc6c-4512-8d9d-962c10f0cad9 is going to be updated. [ 808.511832] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.512024] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.512138] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.512429] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.512674] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.532032] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ecf6012-bc6c-4512-8d9d-962c10f0cad9 in Status: IN_PROGRESS for 2s [ 808.532805] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.532940] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.533011] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.533502] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.533502] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.533502] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.680762] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 85af6c5e-2f9b-491d-9584-96c44b20f99f: rpc.has_security_group_logging(os_id): False [ 808.710111] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.710272] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.710339] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.710569] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.755641] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.755914] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.756536] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.756608] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.756826] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.756932] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.757418] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.757418] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.757418] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.757605] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.757640] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.757919] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.758064] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.758110] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.758242] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.758315] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.758401] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f is going to be updated. [ 808.848739] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.848918] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.849052] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.849363] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.849492] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.849596] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.849672] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.849809] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.849912] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.849988] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.850078] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b60bf9ef-6e65-4c6d-87e2-33b6bcafa939',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.881131] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.881400] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.881400] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.881702] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.881897] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.900337] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f in Status: IN_PROGRESS for 2s [ 808.917236] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7dafcbc-15be-4704-ad92-28657ead70aa taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.917412] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.917500] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.917706] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.917881] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.918028] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.918104] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.918331] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.918413] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.918519] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.918614] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f7dafcbc-15be-4704-ad92-28657ead70aa',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.929785] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd8e3453-8620-4f9d-b764-155e97a20205 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.930138] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd8e3453-8620-4f9d-b764-155e97a20205" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.930138] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd8e3453-8620-4f9d-b764-155e97a20205" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.930268] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd8e3453-8620-4f9d-b764-155e97a20205" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.930413] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.930506] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.930581] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.930722] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.930807] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.931100] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd8e3453-8620-4f9d-b764-155e97a20205" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.931100] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cd8e3453-8620-4f9d-b764-155e97a20205',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.944567] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7195fd-265e-439f-ac03-4bb1a006981b taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.944740] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7195fd-265e-439f-ac03-4bb1a006981b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.944813] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7195fd-265e-439f-ac03-4bb1a006981b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.945071] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7195fd-265e-439f-ac03-4bb1a006981b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.945267] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.945383] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.945450] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.945645] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.945753] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.945889] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7195fd-265e-439f-ac03-4bb1a006981b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.945927] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ca7195fd-265e-439f-ac03-4bb1a006981b',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.951137] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4ca8456-5b21-4080-b762-7b52a4837eb1 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.951137] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.951137] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.951137] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.951137] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.951137] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.951137] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.951137] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.951137] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.951512] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.951512] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e4ca8456-5b21-4080-b762-7b52a4837eb1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.952239] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa1e565f-d426-4783-ad96-ca42d167f6b8 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.952346] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa1e565f-d426-4783-ad96-ca42d167f6b8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.952398] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa1e565f-d426-4783-ad96-ca42d167f6b8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.952548] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa1e565f-d426-4783-ad96-ca42d167f6b8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.952689] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.952781] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.952840] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.952982] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.953081] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.953162] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa1e565f-d426-4783-ad96-ca42d167f6b8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.953246] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aa1e565f-d426-4783-ad96-ca42d167f6b8',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.962627] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9164de2f-6b7d-4419-aa70-d088a6c9ab9f in Status: SUCCESS [ 808.962817] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9164de2f-6b7d-4419-aa70-d088a6c9ab9f deletion is rescheduled due to dependency. [ 808.963097] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9164de2f-6b7d-4419-aa70-d088a6c9ab9f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.978195] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.978476] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.978476] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.978613] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.155201] env[65471]: INFO networking_nsxv3.common.synchronization [req-e4fead00-df8b-4880-8086-a510a47ebd23 req-f0c7ae30-865c-47c2-bd78-b7cad4e6b019 service nova] Enqueued Resource ID: 2ecf6012-bc6c-4512-8d9d-962c10f0cad9 with Priority: HIGHEST for action security_group_rules [ 809.155427] env[65471]: INFO networking_nsxv3.common.synchronization [req-e4fead00-df8b-4880-8086-a510a47ebd23 req-f0c7ae30-865c-47c2-bd78-b7cad4e6b019 service nova] Enqueued Resource ID: 2ecf6012-bc6c-4512-8d9d-962c10f0cad9 with Priority: HIGHEST for action security_group_members [ 809.155628] env[65471]: INFO networking_nsxv3.common.synchronization [req-e4fead00-df8b-4880-8086-a510a47ebd23 req-f0c7ae30-865c-47c2-bd78-b7cad4e6b019 service nova] Enqueued Resource ID: 912d405e-34fe-4d96-ab65-70475e22f599 with Priority: HIGHEST for action port [ 809.156927] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.157149] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.157855] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.158010] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.158667] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.158774] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.159478] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.159620] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.160260] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.160392] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.161090] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.161231] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.161986] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.162089] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.162766] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.162940] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15cae89a-6005-4f02-95eb-d04ef2f8ea8e is going to be deleted. [ 809.165182] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.165182] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.165182] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.165182] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.166109] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.166271] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.167075] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.167075] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.168033] env[65471]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 809.168033] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.168172] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.170475] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ecf6012-bc6c-4512-8d9d-962c10f0cad9 with Priority: HIGHEST for action security_group_rules [ 809.170475] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ecf6012-bc6c-4512-8d9d-962c10f0cad9 with Priority: HIGHEST for action security_group_members [ 809.170475] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 912d405e-34fe-4d96-ab65-70475e22f599 with Priority: HIGHEST for action port [ 809.170475] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ecf6012-bc6c-4512-8d9d-962c10f0cad9 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.170475] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.170475] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.170475] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.170475] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-912d405e-34fe-4d96-ab65-70475e22f599 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.170475] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-912d405e-34fe-4d96-ab65-70475e22f599" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.170475] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-912d405e-34fe-4d96-ab65-70475e22f599" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.170475] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-912d405e-34fe-4d96-ab65-70475e22f599" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.170475] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('912d405e-34fe-4d96-ab65-70475e22f599',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.190535] env[65471]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 809.191188] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.191365] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a is going to be deleted. [ 809.193349] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.193349] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.219656] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.219656] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa46e0ea-568f-4c50-a725-6d162fee238a is going to be deleted. [ 809.220854] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.220854] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.241503] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.241654] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.246318] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.246486] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 453acdc6-7d50-452b-bb4b-66af12a7624a is going to be deleted. [ 809.247854] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.247854] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.260902] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.261200] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.285162] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.285162] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fc157df5-294c-4a29-82ae-e1ec842611f3 is going to be deleted. [ 809.285162] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.285162] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.346520] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.346740] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0dea54fa-53b9-4eb3-a0a7-ce06500a230a is going to be deleted. [ 809.347854] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.348548] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.353832] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.353957] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.354049] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.354283] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.354464] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.354571] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.354637] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.354792] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.354882] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.354974] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.355887] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.356108] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.356206] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.357332] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.357588] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.357744] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.357851] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.358992] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.358992] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.358992] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.358992] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b60bf9ef-6e65-4c6d-87e2-33b6bcafa939',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.359985] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.364268] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.382400] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.382536] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9164de2f-6b7d-4419-aa70-d088a6c9ab9f is going to be deleted. [ 809.384025] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.385040] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.387314] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.387314] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.409708] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.409844] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.411826] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.411826] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2701e2a3-bfcb-431d-b91c-91e91e5af6e1 is going to be deleted. [ 809.412969] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.413475] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.427021] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f7dafcbc-15be-4704-ad92-28657ead70aa',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.458726] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ca7195fd-265e-439f-ac03-4bb1a006981b',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.458726] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cd8e3453-8620-4f9d-b764-155e97a20205',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.465052] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.465258] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cef82843-870a-4b3f-b81f-86da463af87e is going to be deleted. [ 809.466533] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4ca8456-5b21-4080-b762-7b52a4837eb1 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.466533] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.466533] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.466724] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.466874] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.466987] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.469586] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.469853] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.469954] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.470064] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.470249] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4ca8456-5b21-4080-b762-7b52a4837eb1 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.470367] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.470414] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.470581] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.470753] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.470924] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.470994] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.471158] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.471214] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.471294] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.471384] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e4ca8456-5b21-4080-b762-7b52a4837eb1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.472341] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aa1e565f-d426-4783-ad96-ca42d167f6b8',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.474373] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.474646] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.514552] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.514552] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.532195] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.532422] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.538942] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.539036] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.542491] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.542491] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49f0917b-c43e-421e-9ccf-fe8487bf2b37 is going to be deleted. [ 809.543016] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.543860] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.598325] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.598725] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ceb1afc4-63ef-450a-b72c-5b79e8970a01 is going to be deleted. [ 809.600159] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.600309] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.672088] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.672088] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 44e07836-d56c-494a-9b74-978c8fd6933f is going to be deleted. [ 809.672088] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.672088] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.672226] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.672258] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15cae89a-6005-4f02-95eb-d04ef2f8ea8e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.672475] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 912d405e-34fe-4d96-ab65-70475e22f599 with status ACTIVE [ 809.672664] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.672775] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.672837] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.672999] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.673322] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.673478] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.673577] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.673637] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.673793] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.673887] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.674086] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.675517] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.675622] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.675741] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.675818] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.675909] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 912d405e-34fe-4d96-ab65-70475e22f599 is going to be updated. [ 809.677132] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.677297] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.677379] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.677499] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ebb2c820-b9a9-41bb-8cb1-2bfc49704e1a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.682041] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.682140] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.682176] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.682288] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-453acdc6-7d50-452b-bb4b-66af12a7624a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.682908] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.683097] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.683226] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.683358] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa46e0ea-568f-4c50-a725-6d162fee238a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.683817] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.683985] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.684340] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.684515] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fc157df5-294c-4a29-82ae-e1ec842611f3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.686096] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.686096] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.686096] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.686096] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0dea54fa-53b9-4eb3-a0a7-ce06500a230a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.686096] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.686096] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.686096] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.686096] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9164de2f-6b7d-4419-aa70-d088a6c9ab9f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.686096] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.686595] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.686595] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.686595] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2701e2a3-bfcb-431d-b91c-91e91e5af6e1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.738180] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.738391] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.738391] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.738625] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.738718] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.738870] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49f0917b-c43e-421e-9ccf-fe8487bf2b37" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.739877] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.740013] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.740092] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.740281] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.740365] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.740479] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cef82843-870a-4b3f-b81f-86da463af87e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.750223] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.750408] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.750459] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.750633] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.750787] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.751054] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-912d405e-34fe-4d96-ab65-70475e22f599" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.780058] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.781155] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.781155] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.781338] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.781370] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.781493] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ceb1afc4-63ef-450a-b72c-5b79e8970a01" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.858769] env[65471]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 809.860205] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.860381] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.861605] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.861605] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.861605] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.861605] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-44e07836-d56c-494a-9b74-978c8fd6933f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.865412] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b60bf9ef-6e65-4c6d-87e2-33b6bcafa939: rpc.has_security_group_logging(os_id): False [ 809.896516] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.896711] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.896711] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.896970] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.930186] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f7dafcbc-15be-4704-ad92-28657ead70aa: rpc.has_security_group_logging(os_id): False [ 809.943079] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.943079] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.943079] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.943079] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.943079] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.943079] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.943470] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.943517] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.943581] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.943786] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.943860] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.944294] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.946561] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.946561] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.946561] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.946561] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.946561] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 is going to be updated. [ 809.964090] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ca7195fd-265e-439f-ac03-4bb1a006981b: rpc.has_security_group_logging(os_id): False [ 809.964090] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cd8e3453-8620-4f9d-b764-155e97a20205: rpc.has_security_group_logging(os_id): False [ 809.981109] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.981109] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.981109] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.981656] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.982623] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e4ca8456-5b21-4080-b762-7b52a4837eb1: rpc.has_security_group_logging(os_id): False [ 809.984049] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aa1e565f-d426-4783-ad96-ca42d167f6b8: rpc.has_security_group_logging(os_id): False [ 809.995488] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.995488] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.009270] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.009270] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.051499] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.051499] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.051499] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.051499] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.068025] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.068025] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.068025] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.068025] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.068025] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.068025] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.068025] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7dafcbc-15be-4704-ad92-28657ead70aa is going to be updated. [ 810.068025] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.068025] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.107757] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.108647] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.111470] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.111470] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.111470] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.111470] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.111470] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca7195fd-265e-439f-ac03-4bb1a006981b is going to be updated. [ 810.115024] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.115024] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.115024] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.115513] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.152034] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.152034] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.152034] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.152034] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.152034] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.152034] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.152034] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa1e565f-d426-4783-ad96-ca42d167f6b8 is going to be updated. [ 810.152547] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.152892] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.180053] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.180453] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.180632] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.180729] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.181067] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.181210] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.181367] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd8e3453-8620-4f9d-b764-155e97a20205 is going to be updated. [ 810.182646] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.182920] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.183131] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.184210] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.187588] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.187588] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.187588] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.214213] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.214403] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.223805] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.223961] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.224041] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.224100] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.224308] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.224395] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.224609] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.224711] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.224779] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.224990] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.225263] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.225514] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.225637] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.225726] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.225907] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.226029] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.226161] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 is going to be updated. [ 810.227455] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.227684] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.227865] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.229032] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.229240] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.229407] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.238615] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.238830] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.238986] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.239249] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.239434] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.242654] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 in Status: IN_PROGRESS for 2s [ 810.246789] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca7195fd-265e-439f-ac03-4bb1a006981b in Status: IN_PROGRESS for 2s [ 810.251332] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7dafcbc-15be-4704-ad92-28657ead70aa in Status: IN_PROGRESS for 2s [ 810.253839] env[65471]: INFO networking_nsxv3.common.synchronization [req-78b75ced-c67e-43d1-8c38-09c5699970d7 req-3e1871b9-dd8b-411a-8160-9b17775ea08b tempest-SecurityGroupsTestJSON-778312627 tempest-SecurityGroupsTestJSON-778312627-project-member] Enqueued Resource ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 with Priority: HIGHEST for action security_group_members [ 810.254049] env[65471]: INFO networking_nsxv3.common.synchronization [req-78b75ced-c67e-43d1-8c38-09c5699970d7 req-3e1871b9-dd8b-411a-8160-9b17775ea08b tempest-SecurityGroupsTestJSON-778312627 tempest-SecurityGroupsTestJSON-778312627-project-member] Enqueued Resource ID: dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6 with Priority: HIGHEST for action security_group_members [ 810.254619] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 with Priority: HIGHEST for action security_group_members [ 810.254735] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6 with Priority: HIGHEST for action security_group_members [ 810.255135] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.255391] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.255391] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.255641] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.255947] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.256107] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.256198] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.256391] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.256512] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.256632] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b60bf9ef-6e65-4c6d-87e2-33b6bcafa939',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.257603] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.257756] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.257850] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.258139] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.258332] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.258457] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.258541] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.258717] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.258895] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.259074] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.266409] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa1e565f-d426-4783-ad96-ca42d167f6b8 in Status: IN_PROGRESS for 2s [ 810.309851] env[65471]: INFO networking_nsxv3.common.synchronization [req-78b75ced-c67e-43d1-8c38-09c5699970d7 req-3e1871b9-dd8b-411a-8160-9b17775ea08b tempest-SecurityGroupsTestJSON-778312627 tempest-SecurityGroupsTestJSON-778312627-project-member] Enqueued Resource ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 with Priority: HIGHEST for action security_group_rules [ 810.309851] env[65471]: INFO networking_nsxv3.common.synchronization [req-78b75ced-c67e-43d1-8c38-09c5699970d7 req-3e1871b9-dd8b-411a-8160-9b17775ea08b tempest-SecurityGroupsTestJSON-778312627 tempest-SecurityGroupsTestJSON-778312627-project-member] Enqueued Resource ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 with Priority: HIGHEST for action security_group_members [ 810.309851] env[65471]: INFO networking_nsxv3.common.synchronization [req-78b75ced-c67e-43d1-8c38-09c5699970d7 req-3e1871b9-dd8b-411a-8160-9b17775ea08b tempest-SecurityGroupsTestJSON-778312627 tempest-SecurityGroupsTestJSON-778312627-project-member] Enqueued Resource ID: dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6 with Priority: HIGHEST for action security_group_rules [ 810.309851] env[65471]: INFO networking_nsxv3.common.synchronization [req-78b75ced-c67e-43d1-8c38-09c5699970d7 req-3e1871b9-dd8b-411a-8160-9b17775ea08b tempest-SecurityGroupsTestJSON-778312627 tempest-SecurityGroupsTestJSON-778312627-project-member] Enqueued Resource ID: dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6 with Priority: HIGHEST for action security_group_members [ 810.309851] env[65471]: INFO networking_nsxv3.common.synchronization [req-78b75ced-c67e-43d1-8c38-09c5699970d7 req-3e1871b9-dd8b-411a-8160-9b17775ea08b tempest-SecurityGroupsTestJSON-778312627 tempest-SecurityGroupsTestJSON-778312627-project-member] Enqueued Resource ID: b16a3c90-0195-4cc5-981a-6aadd036abe0 with Priority: HIGHEST for action port [ 810.310366] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 with Priority: HIGHEST for action security_group_rules [ 810.310534] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6 with Priority: HIGHEST for action security_group_rules [ 810.310633] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b16a3c90-0195-4cc5-981a-6aadd036abe0 with Priority: HIGHEST for action port [ 810.310723] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 with Priority: HIGHEST for action security_group_members [ 810.310808] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6 with Priority: HIGHEST for action security_group_members [ 810.311240] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.311323] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.314565] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.314565] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.314565] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.314565] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.314565] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.314565] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-b16a3c90-0195-4cc5-981a-6aadd036abe0 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.314565] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b16a3c90-0195-4cc5-981a-6aadd036abe0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.314565] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b16a3c90-0195-4cc5-981a-6aadd036abe0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.314565] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b16a3c90-0195-4cc5-981a-6aadd036abe0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.314565] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b16a3c90-0195-4cc5-981a-6aadd036abe0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.317497] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.317624] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.317852] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.317964] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.357725] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.357909] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.357983] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.358230] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.358386] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.388823] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd8e3453-8620-4f9d-b764-155e97a20205 in Status: IN_PROGRESS for 2s [ 810.400845] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.400845] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.400845] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.401224] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.401292] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.421552] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 in Status: IN_PROGRESS for 2s [ 810.543976] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ecf6012-bc6c-4512-8d9d-962c10f0cad9 in Status: SUCCESS [ 810.544375] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.544605] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.544923] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.545226] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.545425] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.545613] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.545802] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.545969] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.546402] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.546617] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2ecf6012-bc6c-4512-8d9d-962c10f0cad9',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.548180] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.548437] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.548719] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.548868] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.548948] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.549171] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.549488] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.549666] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ecf6012-bc6c-4512-8d9d-962c10f0cad9',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.725423] env[65471]: INFO networking_nsxv3.common.synchronization [None req-0cdd8405-81ed-4cc7-b372-baae80453ab7 tempest-AttachVolumeNegativeTest-275281664 tempest-AttachVolumeNegativeTest-275281664-project-member] Enqueued Resource ID: 8a168c13-528b-4758-b139-f0aa310cde5c with Priority: HIGHEST for action security_group_rules [ 810.726832] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a168c13-528b-4758-b139-f0aa310cde5c with Priority: HIGHEST for action security_group_rules [ 810.727825] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a168c13-528b-4758-b139-f0aa310cde5c taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.728074] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a168c13-528b-4758-b139-f0aa310cde5c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.728176] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a168c13-528b-4758-b139-f0aa310cde5c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.728556] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a168c13-528b-4758-b139-f0aa310cde5c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.729036] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a168c13-528b-4758-b139-f0aa310cde5c',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.760933] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b60bf9ef-6e65-4c6d-87e2-33b6bcafa939',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.763321] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.818602] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b16a3c90-0195-4cc5-981a-6aadd036abe0 with status ACTIVE [ 810.818905] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.819104] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.819196] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.819549] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.819631] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.819781] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.819909] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.819988] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.820189] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.820304] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.820504] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.820626] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.820712] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.820847] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.820973] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.821092] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b16a3c90-0195-4cc5-981a-6aadd036abe0 is going to be updated. [ 810.822826] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.823071] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.846838] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.847699] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.847811] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.848067] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.848250] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.849188] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b16a3c90-0195-4cc5-981a-6aadd036abe0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.915377] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f in Status: SUCCESS [ 810.919021] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.943737] env[65471]: INFO networking_nsxv3.common.synchronization [None req-3729c440-a9ac-43d3-9922-a761ca45c106 tempest-AttachVolumeNegativeTest-275281664 tempest-AttachVolumeNegativeTest-275281664-project-member] Enqueued Resource ID: 8a168c13-528b-4758-b139-f0aa310cde5c with Priority: HIGHEST for action security_group_rules [ 810.943737] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a168c13-528b-4758-b139-f0aa310cde5c with Priority: HIGHEST for action security_group_rules [ 810.944651] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a168c13-528b-4758-b139-f0aa310cde5c taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.944802] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a168c13-528b-4758-b139-f0aa310cde5c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.052333] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.052677] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.052677] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2ecf6012-bc6c-4512-8d9d-962c10f0cad9',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.258072] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.258072] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.258072] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.258072] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.258072] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.258072] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a168c13-528b-4758-b139-f0aa310cde5c already deleted. [ 811.258072] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a168c13-528b-4758-b139-f0aa310cde5c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.258526] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a168c13-528b-4758-b139-f0aa310cde5c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.258614] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a168c13-528b-4758-b139-f0aa310cde5c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.258767] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a168c13-528b-4758-b139-f0aa310cde5c',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.266058] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.267304] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b60bf9ef-6e65-4c6d-87e2-33b6bcafa939',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.334460] env[65471]: INFO networking_nsxv3.common.synchronization [None req-f3c2932b-7b01-4038-8b96-b41fb8d20b6d None None] Enqueued Resource ID: 56050080-0772-483f-bbe6-6ab836b3ed08 with Priority: HIGHEST for action port [ 811.335801] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56050080-0772-483f-bbe6-6ab836b3ed08 with Priority: HIGHEST for action port [ 811.336234] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-56050080-0772-483f-bbe6-6ab836b3ed08 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.336401] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-56050080-0772-483f-bbe6-6ab836b3ed08" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.336646] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-56050080-0772-483f-bbe6-6ab836b3ed08" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.337242] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-56050080-0772-483f-bbe6-6ab836b3ed08" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.337242] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56050080-0772-483f-bbe6-6ab836b3ed08',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.556107] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2ecf6012-bc6c-4512-8d9d-962c10f0cad9',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.769414] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.769584] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.769679] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.771090] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.771090] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.771090] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6 is going to be created. [ 811.775559] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.775828] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.775980] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.776266] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.776389] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.776549] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 is going to be updated. [ 811.786687] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.786909] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.786992] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.787299] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.787446] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.787603] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a168c13-528b-4758-b139-f0aa310cde5c already deleted. [ 811.787723] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a168c13-528b-4758-b139-f0aa310cde5c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.824483] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.824483] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.824730] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.824770] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.824926] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.832478] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.832619] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.832780] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.832886] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.833054] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.840393] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6 in Status: UNINITIALIZED for 2s [ 811.840393] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 56050080-0772-483f-bbe6-6ab836b3ed08 [ 811.840631] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.840841] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.841060] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.841307] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.841430] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.841547] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:56050080-0772-483f-bbe6-6ab836b3ed08 already deleted. [ 811.841833] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-56050080-0772-483f-bbe6-6ab836b3ed08" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.842937] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 in Status: IN_PROGRESS for 2s [ 812.063536] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.063866] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.063866] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.063866] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.064033] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.064033] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ecf6012-bc6c-4512-8d9d-962c10f0cad9 is going to be updated. [ 812.106040] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.106040] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.106313] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.106520] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.106705] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.120544] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ecf6012-bc6c-4512-8d9d-962c10f0cad9 in Status: IN_PROGRESS for 2s [ 812.256709] env[65471]: INFO networking_nsxv3.common.synchronization [None req-e314bdaf-dc06-48d1-a864-e5947650f71d None None] Enqueued Resource ID: 73cbdb0b-5535-4d53-9f1c-787724b2557d with Priority: HIGHEST for action port [ 812.258845] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73cbdb0b-5535-4d53-9f1c-787724b2557d with Priority: HIGHEST for action port [ 812.259160] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-73cbdb0b-5535-4d53-9f1c-787724b2557d taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.259582] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-73cbdb0b-5535-4d53-9f1c-787724b2557d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.259750] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-73cbdb0b-5535-4d53-9f1c-787724b2557d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.260637] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-73cbdb0b-5535-4d53-9f1c-787724b2557d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.260769] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73cbdb0b-5535-4d53-9f1c-787724b2557d',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.275021] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca7195fd-265e-439f-ac03-4bb1a006981b in Status: SUCCESS [ 812.275021] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca7195fd-265e-439f-ac03-4bb1a006981b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.275651] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 in Status: SUCCESS [ 812.275837] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.276619] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7dafcbc-15be-4704-ad92-28657ead70aa in Status: SUCCESS [ 812.276798] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.277509] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.277651] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.277704] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b60bf9ef-6e65-4c6d-87e2-33b6bcafa939',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.285538] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa1e565f-d426-4783-ad96-ca42d167f6b8 in Status: SUCCESS [ 812.285759] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa1e565f-d426-4783-ad96-ca42d167f6b8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.408561] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd8e3453-8620-4f9d-b764-155e97a20205 in Status: SUCCESS [ 812.408561] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd8e3453-8620-4f9d-b764-155e97a20205" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.444638] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 in Status: SUCCESS [ 812.445023] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.763326] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 73cbdb0b-5535-4d53-9f1c-787724b2557d [ 812.763659] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.763831] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.763880] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.764539] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.764539] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.764539] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:73cbdb0b-5535-4d53-9f1c-787724b2557d already deleted. [ 812.764539] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-73cbdb0b-5535-4d53-9f1c-787724b2557d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.782744] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.782882] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.861094] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 in Status: SUCCESS [ 813.861422] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.862768] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6 in Status: SUCCESS [ 813.862768] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.862893] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.865492] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.866809] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.866809] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.866809] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.866809] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.866809] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.866809] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b60bf9ef-6e65-4c6d-87e2-33b6bcafa939',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.867763] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.867982] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.868197] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.868328] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.868414] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.868580] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.868683] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.868777] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.135333] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ecf6012-bc6c-4512-8d9d-962c10f0cad9 in Status: SUCCESS [ 814.135837] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.139340] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.139340] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.139340] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.139340] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.139340] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.139340] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.139340] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.139340] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.139340] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.139340] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.139340] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.139951] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.139986] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.140096] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.140162] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.140884] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.140884] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.140884] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.140884] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2ecf6012-bc6c-4512-8d9d-962c10f0cad9',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.371789] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b60bf9ef-6e65-4c6d-87e2-33b6bcafa939',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.373623] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.557221] env[65471]: INFO networking_nsxv3.common.synchronization [None req-82534e7d-784a-42e3-b5c7-5539c2201c7e None None] Enqueued Resource ID: 22d1a2e0-bdd0-42bd-bd97-67afc0092321 with Priority: HIGHEST for action port [ 814.557987] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22d1a2e0-bdd0-42bd-bd97-67afc0092321 with Priority: HIGHEST for action port [ 814.558866] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-22d1a2e0-bdd0-42bd-bd97-67afc0092321 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.559096] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-22d1a2e0-bdd0-42bd-bd97-67afc0092321" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.559289] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-22d1a2e0-bdd0-42bd-bd97-67afc0092321" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.559600] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-22d1a2e0-bdd0-42bd-bd97-67afc0092321" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.559737] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('22d1a2e0-bdd0-42bd-bd97-67afc0092321',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.645131] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2ecf6012-bc6c-4512-8d9d-962c10f0cad9: rpc.has_security_group_logging(os_id): False [ 814.664678] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.664678] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.664678] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.664817] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.687553] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.687645] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.687783] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.687884] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.688116] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.688201] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.688593] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.688701] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.688768] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.689657] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.689657] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.690889] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.691190] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.691190] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.691361] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.691453] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.691555] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ecf6012-bc6c-4512-8d9d-962c10f0cad9 is going to be updated. [ 814.844660] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.844867] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.845033] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.845134] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.845269] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.864697] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ecf6012-bc6c-4512-8d9d-962c10f0cad9 in Status: IN_PROGRESS for 2s [ 814.875560] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.876595] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b60bf9ef-6e65-4c6d-87e2-33b6bcafa939',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.064546] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 22d1a2e0-bdd0-42bd-bd97-67afc0092321 [ 815.064907] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.065139] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.065223] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.065502] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.065597] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.065713] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:22d1a2e0-bdd0-42bd-bd97-67afc0092321 already deleted. [ 815.065804] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-22d1a2e0-bdd0-42bd-bd97-67afc0092321" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.378951] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.379226] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.379226] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.379430] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.379819] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.379819] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6 is going to be updated. [ 815.381199] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.381199] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.381199] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.381478] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.381478] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.381633] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 is going to be updated. [ 815.429599] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.430172] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.430172] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.430172] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.430307] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.434483] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.434483] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.434483] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.434483] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.434483] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.446135] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6 in Status: IN_PROGRESS for 2s [ 815.446828] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 in Status: IN_PROGRESS for 2s [ 816.880195] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ecf6012-bc6c-4512-8d9d-962c10f0cad9 in Status: SUCCESS [ 816.880466] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.880608] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.880814] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.880898] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ecf6012-bc6c-4512-8d9d-962c10f0cad9',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.383186] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.383379] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.383477] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.384163] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.384163] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.384163] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.384163] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.384163] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.384498] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.384498] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.384498] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2ecf6012-bc6c-4512-8d9d-962c10f0cad9',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.459373] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 in Status: SUCCESS [ 817.459482] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.460115] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.460115] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.460285] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.460427] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.460502] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.460675] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.460826] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.460861] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.460937] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b60bf9ef-6e65-4c6d-87e2-33b6bcafa939',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.463407] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6 in Status: SUCCESS [ 817.464147] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.464147] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.464147] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.464414] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.465639] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.465753] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.465882] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.465997] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.466131] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.466235] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.888196] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.888196] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.888196] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.888196] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.888196] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.888196] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.888629] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.888629] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.888629] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.888629] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.888749] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.888897] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.889032] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.889099] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.889249] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.889334] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.889391] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.889523] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.889592] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.889668] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.889753] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2ecf6012-bc6c-4512-8d9d-962c10f0cad9',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.969158] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.969320] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.969385] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.969606] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.971113] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.971313] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.971388] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.971574] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.971666] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.971757] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.971928] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.972462] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.972462] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.972462] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.974076] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.974197] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.974264] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.974428] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.974514] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.974604] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.974702] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b60bf9ef-6e65-4c6d-87e2-33b6bcafa939',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.975873] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.270199] env[65471]: INFO networking_nsxv3.common.synchronization [None req-9439e62e-318e-424a-a060-3af1545b5a0e None None] Enqueued Resource ID: a2c1468e-92c7-44f9-82d1-d33d7664ce72 with Priority: HIGHEST for action port [ 818.273245] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2c1468e-92c7-44f9-82d1-d33d7664ce72 with Priority: HIGHEST for action port [ 818.273394] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-a2c1468e-92c7-44f9-82d1-d33d7664ce72 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.273843] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a2c1468e-92c7-44f9-82d1-d33d7664ce72" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.273843] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a2c1468e-92c7-44f9-82d1-d33d7664ce72" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.273989] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a2c1468e-92c7-44f9-82d1-d33d7664ce72" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.273989] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2c1468e-92c7-44f9-82d1-d33d7664ce72',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.392277] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2ecf6012-bc6c-4512-8d9d-962c10f0cad9: rpc.has_security_group_logging(os_id): False [ 818.411929] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.411929] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.411929] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.412220] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.412272] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.412532] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.412607] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.412656] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.412780] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.412859] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.413045] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.413230] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.413708] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.413708] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.413708] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.413834] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.413896] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.413961] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.414445] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.414445] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.414445] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ecf6012-bc6c-4512-8d9d-962c10f0cad9 is going to be updated. [ 818.477419] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b60bf9ef-6e65-4c6d-87e2-33b6bcafa939: rpc.has_security_group_logging(os_id): False [ 818.479105] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6: rpc.has_security_group_logging(os_id): False [ 818.491307] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.491586] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.491719] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.492075] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.493236] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.498796] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.498949] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.499031] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.499258] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.500157] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.500157] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.500157] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.500157] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.500157] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.500157] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.501638] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.501638] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.501638] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.501638] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.501638] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.501638] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.501638] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.501638] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.501638] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.501638] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.501638] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 is going to be updated. [ 818.503210] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.504479] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.504479] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.504479] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.504479] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.504479] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.504479] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.504479] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.504479] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.504479] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.504479] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6 is going to be created. [ 818.522181] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ecf6012-bc6c-4512-8d9d-962c10f0cad9 in Status: IN_PROGRESS for 2s [ 818.606812] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.607602] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.609398] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.609578] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.609840] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.629418] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.629608] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.629714] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.629977] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.630281] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.633777] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6 in Status: IN_PROGRESS for 2s [ 818.650948] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 in Status: IN_PROGRESS for 2s [ 818.776888] env[65471]: INFO networking_nsxv3.common.synchronization [req-21291b42-fc3f-499b-b3bb-ff78e723a8e6 req-9cc69a49-d600-45ff-a5b7-6396251fca6b tempest-SecurityGroupsTestJSON-778312627 tempest-SecurityGroupsTestJSON-778312627-project-member] Enqueued Resource ID: dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6 with Priority: HIGHEST for action security_group_members [ 818.776966] env[65471]: INFO networking_nsxv3.common.synchronization [req-21291b42-fc3f-499b-b3bb-ff78e723a8e6 req-9cc69a49-d600-45ff-a5b7-6396251fca6b tempest-SecurityGroupsTestJSON-778312627 tempest-SecurityGroupsTestJSON-778312627-project-member] Enqueued Resource ID: da75c38e-887c-4ea5-bd53-f17b356cd114 with Priority: HIGHEST for action security_group_members [ 818.777098] env[65471]: INFO networking_nsxv3.common.synchronization [req-21291b42-fc3f-499b-b3bb-ff78e723a8e6 req-9cc69a49-d600-45ff-a5b7-6396251fca6b tempest-SecurityGroupsTestJSON-778312627 tempest-SecurityGroupsTestJSON-778312627-project-member] Enqueued Resource ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 with Priority: HIGHEST for action security_group_members [ 818.778255] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a2c1468e-92c7-44f9-82d1-d33d7664ce72 [ 818.778255] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.778255] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.778255] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.778255] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.778255] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.778255] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a2c1468e-92c7-44f9-82d1-d33d7664ce72 already deleted. [ 818.778255] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a2c1468e-92c7-44f9-82d1-d33d7664ce72" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.780107] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6 with Priority: HIGHEST for action security_group_members [ 818.780107] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da75c38e-887c-4ea5-bd53-f17b356cd114 with Priority: HIGHEST for action security_group_members [ 818.780107] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 with Priority: HIGHEST for action security_group_members [ 818.780107] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.780107] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.780107] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.780439] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.780475] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.780574] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.780632] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.780800] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.780877] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.781027] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.782144] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-da75c38e-887c-4ea5-bd53-f17b356cd114 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.782814] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da75c38e-887c-4ea5-bd53-f17b356cd114" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.782907] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da75c38e-887c-4ea5-bd53-f17b356cd114" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.783268] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da75c38e-887c-4ea5-bd53-f17b356cd114" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.783424] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.783691] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.783691] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.783765] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.783870] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.783983] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da75c38e-887c-4ea5-bd53-f17b356cd114',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.784801] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.784907] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.784969] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.785135] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.785272] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.785361] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.785415] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.785549] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.785640] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.785698] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b60bf9ef-6e65-4c6d-87e2-33b6bcafa939',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.844095] env[65471]: INFO networking_nsxv3.common.synchronization [req-21291b42-fc3f-499b-b3bb-ff78e723a8e6 req-9cc69a49-d600-45ff-a5b7-6396251fca6b tempest-SecurityGroupsTestJSON-778312627 tempest-SecurityGroupsTestJSON-778312627-project-member] Enqueued Resource ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 with Priority: HIGHEST for action security_group_rules [ 818.844371] env[65471]: INFO networking_nsxv3.common.synchronization [req-21291b42-fc3f-499b-b3bb-ff78e723a8e6 req-9cc69a49-d600-45ff-a5b7-6396251fca6b tempest-SecurityGroupsTestJSON-778312627 tempest-SecurityGroupsTestJSON-778312627-project-member] Enqueued Resource ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 with Priority: HIGHEST for action security_group_members [ 818.844458] env[65471]: INFO networking_nsxv3.common.synchronization [req-21291b42-fc3f-499b-b3bb-ff78e723a8e6 req-9cc69a49-d600-45ff-a5b7-6396251fca6b tempest-SecurityGroupsTestJSON-778312627 tempest-SecurityGroupsTestJSON-778312627-project-member] Enqueued Resource ID: da75c38e-887c-4ea5-bd53-f17b356cd114 with Priority: HIGHEST for action security_group_rules [ 818.844601] env[65471]: INFO networking_nsxv3.common.synchronization [req-21291b42-fc3f-499b-b3bb-ff78e723a8e6 req-9cc69a49-d600-45ff-a5b7-6396251fca6b tempest-SecurityGroupsTestJSON-778312627 tempest-SecurityGroupsTestJSON-778312627-project-member] Enqueued Resource ID: da75c38e-887c-4ea5-bd53-f17b356cd114 with Priority: HIGHEST for action security_group_members [ 818.844726] env[65471]: INFO networking_nsxv3.common.synchronization [req-21291b42-fc3f-499b-b3bb-ff78e723a8e6 req-9cc69a49-d600-45ff-a5b7-6396251fca6b tempest-SecurityGroupsTestJSON-778312627 tempest-SecurityGroupsTestJSON-778312627-project-member] Enqueued Resource ID: dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6 with Priority: HIGHEST for action security_group_rules [ 818.844844] env[65471]: INFO networking_nsxv3.common.synchronization [req-21291b42-fc3f-499b-b3bb-ff78e723a8e6 req-9cc69a49-d600-45ff-a5b7-6396251fca6b tempest-SecurityGroupsTestJSON-778312627 tempest-SecurityGroupsTestJSON-778312627-project-member] Enqueued Resource ID: dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6 with Priority: HIGHEST for action security_group_members [ 818.844964] env[65471]: INFO networking_nsxv3.common.synchronization [req-21291b42-fc3f-499b-b3bb-ff78e723a8e6 req-9cc69a49-d600-45ff-a5b7-6396251fca6b tempest-SecurityGroupsTestJSON-778312627 tempest-SecurityGroupsTestJSON-778312627-project-member] Enqueued Resource ID: b16a3c90-0195-4cc5-981a-6aadd036abe0 with Priority: HIGHEST for action port [ 818.846309] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 with Priority: HIGHEST for action security_group_rules [ 818.846396] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da75c38e-887c-4ea5-bd53-f17b356cd114 with Priority: HIGHEST for action security_group_rules [ 818.846501] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6 with Priority: HIGHEST for action security_group_members [ 818.846594] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b16a3c90-0195-4cc5-981a-6aadd036abe0 with Priority: HIGHEST for action port [ 818.846687] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6 with Priority: HIGHEST for action security_group_rules [ 818.846775] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 with Priority: HIGHEST for action security_group_members [ 818.846862] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da75c38e-887c-4ea5-bd53-f17b356cd114 with Priority: HIGHEST for action security_group_members [ 818.847441] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.847557] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.847762] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da75c38e-887c-4ea5-bd53-f17b356cd114 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.847868] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da75c38e-887c-4ea5-bd53-f17b356cd114" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.847930] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da75c38e-887c-4ea5-bd53-f17b356cd114" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.848228] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da75c38e-887c-4ea5-bd53-f17b356cd114" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.848370] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da75c38e-887c-4ea5-bd53-f17b356cd114',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.849809] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.849941] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.850103] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-b16a3c90-0195-4cc5-981a-6aadd036abe0 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.850203] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b16a3c90-0195-4cc5-981a-6aadd036abe0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.850264] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b16a3c90-0195-4cc5-981a-6aadd036abe0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.851350] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b16a3c90-0195-4cc5-981a-6aadd036abe0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.851443] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b16a3c90-0195-4cc5-981a-6aadd036abe0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.852360] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.852446] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.852641] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.852724] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.852928] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-da75c38e-887c-4ea5-bd53-f17b356cd114 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.853023] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da75c38e-887c-4ea5-bd53-f17b356cd114" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.288016] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('da75c38e-887c-4ea5-bd53-f17b356cd114',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.289129] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.290096] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b60bf9ef-6e65-4c6d-87e2-33b6bcafa939',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.354520] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-da75c38e-887c-4ea5-bd53-f17b356cd114 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.354520] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da75c38e-887c-4ea5-bd53-f17b356cd114" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.355933] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b16a3c90-0195-4cc5-981a-6aadd036abe0 with status ACTIVE [ 819.356238] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.356395] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.356484] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.357756] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.357756] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.357756] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.357756] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.357756] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.357756] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.357756] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.357756] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.358109] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.358528] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.359596] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.359596] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.359596] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b16a3c90-0195-4cc5-981a-6aadd036abe0 is going to be updated. [ 819.383314] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.383609] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.384101] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.384101] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.384315] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.384658] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b16a3c90-0195-4cc5-981a-6aadd036abe0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.790820] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('da75c38e-887c-4ea5-bd53-f17b356cd114',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.791982] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.792615] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b60bf9ef-6e65-4c6d-87e2-33b6bcafa939',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.855424] env[65471]: INFO networking_nsxv3.common.synchronization [req-406320ec-70ec-4c33-8dbf-3780bf40e364 req-5d2abbcf-3571-4dc4-8d91-5f0400c6869b tempest-ServerDiskConfigTestJSON-1443816332 tempest-ServerDiskConfigTestJSON-1443816332-project-member] Enqueued Resource ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e with Priority: HIGHEST for action security_group_members [ 819.855947] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e with Priority: HIGHEST for action security_group_members [ 819.856398] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.858121] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.858432] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.860530] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.860530] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.860530] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.860530] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.860530] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.860530] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.860530] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c8a6eda-c0ec-4e25-8652-6acf3d57da4e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.249916] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock network-537 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.250192] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "network-537" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.250361] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "network-537" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.250672] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "network-537" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.251023] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.251243] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.251386] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.251632] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.251784] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.252079] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 820.252239] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 820.252360] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 820.252478] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 820.252621] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 820.252733] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 820.252894] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 820.274314] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 820.274477] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 820.274616] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 820.274795] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "network-537" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.275282] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock port-4342b400-8592-4197-9478-ddac5ef79bd3 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.275584] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "port-4342b400-8592-4197-9478-ddac5ef79bd3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.275584] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "port-4342b400-8592-4197-9478-ddac5ef79bd3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.276392] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "port-4342b400-8592-4197-9478-ddac5ef79bd3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.276392] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4342b400-8592-4197-9478-ddac5ef79bd3',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.294792] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.294792] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.295192] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.295192] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.295192] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.295362] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da75c38e-887c-4ea5-bd53-f17b356cd114 is going to be created. [ 820.296791] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.296966] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.297183] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.297303] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.297363] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.297466] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6 is going to be updated. [ 820.298551] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.298655] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.298719] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.298958] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.298958] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.299091] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 is going to be updated. [ 820.347747] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.347883] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.347883] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.348087] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.348251] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.362799] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.363036] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.363036] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.363325] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.364907] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.365034] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.365112] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.365285] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.365422] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.366549] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.366662] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.366723] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.366869] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.366988] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.368342] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da75c38e-887c-4ea5-bd53-f17b356cd114 in Status: UNINITIALIZED for 2s [ 820.395175] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 in Status: IN_PROGRESS for 2s [ 820.395175] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6 in Status: IN_PROGRESS for 2s [ 820.422852] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.422852] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.422852] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.422852] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.422852] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.422852] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.422852] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e is going to be updated. [ 820.454833] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.454833] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.454833] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.454833] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.454833] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.465503] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e in Status: IN_PROGRESS for 2s [ 820.542337] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ecf6012-bc6c-4512-8d9d-962c10f0cad9 in Status: SUCCESS [ 820.542572] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.620269] env[65471]: INFO networking_nsxv3.common.synchronization [req-b632a907-8cf7-484d-a4b9-b7a183824241 req-d441736a-4ffa-456d-acba-daae10f57ddc tempest-ServersAdminTestJSON-1197360877 tempest-ServersAdminTestJSON-1197360877-project-member] Enqueued Resource ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 with Priority: HIGHEST for action security_group_members [ 820.620399] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 with Priority: HIGHEST for action security_group_members [ 820.620711] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4ca8456-5b21-4080-b762-7b52a4837eb1 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.620838] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.620894] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.623034] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.623034] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.623034] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.623034] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.623034] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.623034] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.623034] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4ca8456-5b21-4080-b762-7b52a4837eb1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.646833] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6 in Status: SUCCESS [ 820.649079] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.649079] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.649079] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.649079] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.670761] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 in Status: SUCCESS [ 820.671355] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.671683] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.672039] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.672391] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b60bf9ef-6e65-4c6d-87e2-33b6bcafa939',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.780465] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.780465] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.780465] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.780465] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.780833] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.780833] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Segment Port 4342b400-8592-4197-9478-ddac5ef79bd3 not found, creating... [ 820.781462] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.781462] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.781701] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.781813] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.782125] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.783060] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.783382] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.783591] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.783897] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.784108] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.784322] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Resource: SegmentPort with ID: 4342b400-8592-4197-9478-ddac5ef79bd3 is going to be created. [ 820.823830] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.824115] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.824859] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.824859] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.824859] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.825086] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "port-4342b400-8592-4197-9478-ddac5ef79bd3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.929881] env[65471]: INFO networking_nsxv3.common.synchronization [None req-1d5c68af-6695-4a2c-b110-21e99ab1ff27 None None] Enqueued Resource ID: f1ac1245-51eb-44ce-b8f1-8a7ebfe56f58 with Priority: HIGHEST for action port [ 820.930636] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1ac1245-51eb-44ce-b8f1-8a7ebfe56f58 with Priority: HIGHEST for action port [ 820.931139] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-f1ac1245-51eb-44ce-b8f1-8a7ebfe56f58 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.931254] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f1ac1245-51eb-44ce-b8f1-8a7ebfe56f58" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.931341] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f1ac1245-51eb-44ce-b8f1-8a7ebfe56f58" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.931576] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f1ac1245-51eb-44ce-b8f1-8a7ebfe56f58" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.931663] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1ac1245-51eb-44ce-b8f1-8a7ebfe56f58',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.124073] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e4ca8456-5b21-4080-b762-7b52a4837eb1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.150283] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.150460] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.175602] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.175756] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.434854] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f1ac1245-51eb-44ce-b8f1-8a7ebfe56f58 [ 821.435169] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.435317] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.435405] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.435651] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.435763] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.435877] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f1ac1245-51eb-44ce-b8f1-8a7ebfe56f58 already deleted. [ 821.435970] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f1ac1245-51eb-44ce-b8f1-8a7ebfe56f58" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.590263] env[65471]: INFO networking_nsxv3.common.synchronization [req-406320ec-70ec-4c33-8dbf-3780bf40e364 req-1efbbee3-d4a4-4241-b3ab-013bddc611f7 service nova] Enqueued Resource ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e with Priority: HIGHEST for action security_group_rules [ 821.591230] env[65471]: INFO networking_nsxv3.common.synchronization [req-406320ec-70ec-4c33-8dbf-3780bf40e364 req-1efbbee3-d4a4-4241-b3ab-013bddc611f7 service nova] Enqueued Resource ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e with Priority: HIGHEST for action security_group_members [ 821.591230] env[65471]: INFO networking_nsxv3.common.synchronization [req-406320ec-70ec-4c33-8dbf-3780bf40e364 req-1efbbee3-d4a4-4241-b3ab-013bddc611f7 service nova] Enqueued Resource ID: 4342b400-8592-4197-9478-ddac5ef79bd3 with Priority: HIGHEST for action port [ 821.591602] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e with Priority: HIGHEST for action security_group_rules [ 821.591602] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e with Priority: HIGHEST for action security_group_members [ 821.591858] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4342b400-8592-4197-9478-ddac5ef79bd3 with Priority: HIGHEST for action port [ 821.592191] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.592304] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.592369] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.592594] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.592714] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1c8a6eda-c0ec-4e25-8652-6acf3d57da4e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.594211] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.594363] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.594667] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-4342b400-8592-4197-9478-ddac5ef79bd3 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.595526] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4342b400-8592-4197-9478-ddac5ef79bd3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.595946] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4342b400-8592-4197-9478-ddac5ef79bd3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.596166] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4342b400-8592-4197-9478-ddac5ef79bd3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.597820] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4342b400-8592-4197-9478-ddac5ef79bd3',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.666038] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e4ca8456-5b21-4080-b762-7b52a4837eb1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.100874] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.100874] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.100874] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4342b400-8592-4197-9478-ddac5ef79bd3 with status ACTIVE [ 822.101056] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.101056] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.101229] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.103379] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.103379] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.103379] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.103379] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.103379] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.103379] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.103379] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.103379] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.103379] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.103379] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.103379] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.103379] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.103379] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4342b400-8592-4197-9478-ddac5ef79bd3 is going to be updated. [ 822.127288] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.127530] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.127639] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.127859] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.128009] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.128187] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4342b400-8592-4197-9478-ddac5ef79bd3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.168289] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.168469] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.168522] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.168721] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.168804] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.168905] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 is going to be updated. [ 822.212385] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.212621] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.212621] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.212809] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.212957] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.224094] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 in Status: IN_PROGRESS for 2s [ 822.380350] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da75c38e-887c-4ea5-bd53-f17b356cd114 in Status: SUCCESS [ 822.380350] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da75c38e-887c-4ea5-bd53-f17b356cd114" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.380350] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da75c38e-887c-4ea5-bd53-f17b356cd114" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.380508] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da75c38e-887c-4ea5-bd53-f17b356cd114" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.380583] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.380717] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.380782] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.380972] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.381242] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.381363] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da75c38e-887c-4ea5-bd53-f17b356cd114',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.404101] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 in Status: SUCCESS [ 822.404342] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.404509] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.404715] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.404904] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.405033] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.405102] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.405257] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.405336] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.405431] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b60bf9ef-6e65-4c6d-87e2-33b6bcafa939',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.406938] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6 in Status: SUCCESS [ 822.407085] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.407562] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.407753] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.407930] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.408134] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.408205] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.408351] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.408466] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.408563] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.477808] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e in Status: SUCCESS [ 822.477808] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e deletion is rescheduled due to dependency. [ 822.477808] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.477808] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.477808] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.477808] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.478488] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.478488] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.478488] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.478488] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.478488] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c8a6eda-c0ec-4e25-8652-6acf3d57da4e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.536698] env[65471]: INFO networking_nsxv3.common.synchronization [req-7da2f90c-dc2f-4ff7-bf4b-274c185b26be req-b09a92c4-41c2-4133-a083-d2dcc00b53a1 tempest-SecurityGroupsTestJSON-778312627 tempest-SecurityGroupsTestJSON-778312627-project-member] Enqueued Resource ID: da75c38e-887c-4ea5-bd53-f17b356cd114 with Priority: HIGHEST for action security_group_members [ 822.536894] env[65471]: INFO networking_nsxv3.common.synchronization [req-7da2f90c-dc2f-4ff7-bf4b-274c185b26be req-b09a92c4-41c2-4133-a083-d2dcc00b53a1 tempest-SecurityGroupsTestJSON-778312627 tempest-SecurityGroupsTestJSON-778312627-project-member] Enqueued Resource ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 with Priority: HIGHEST for action security_group_members [ 822.537035] env[65471]: INFO networking_nsxv3.common.synchronization [req-7da2f90c-dc2f-4ff7-bf4b-274c185b26be req-b09a92c4-41c2-4133-a083-d2dcc00b53a1 tempest-SecurityGroupsTestJSON-778312627 tempest-SecurityGroupsTestJSON-778312627-project-member] Enqueued Resource ID: dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6 with Priority: HIGHEST for action security_group_members [ 822.537559] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da75c38e-887c-4ea5-bd53-f17b356cd114 with Priority: HIGHEST for action security_group_members [ 822.537693] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 with Priority: HIGHEST for action security_group_members [ 822.537793] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6 with Priority: HIGHEST for action security_group_members [ 822.538677] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-da75c38e-887c-4ea5-bd53-f17b356cd114 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.538677] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da75c38e-887c-4ea5-bd53-f17b356cd114" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.538677] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.538677] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.539918] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.539918] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.884039] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('da75c38e-887c-4ea5-bd53-f17b356cd114',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.911026] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b60bf9ef-6e65-4c6d-87e2-33b6bcafa939',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.911907] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.980758] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1c8a6eda-c0ec-4e25-8652-6acf3d57da4e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.388011] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('da75c38e-887c-4ea5-bd53-f17b356cd114',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.415419] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b60bf9ef-6e65-4c6d-87e2-33b6bcafa939',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.415802] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.483623] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1c8a6eda-c0ec-4e25-8652-6acf3d57da4e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.891174] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.891174] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.891309] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.891499] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.891590] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.891703] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da75c38e-887c-4ea5-bd53-f17b356cd114 is going to be updated. [ 823.918048] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.918235] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.918307] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.918527] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.918614] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.918712] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 is going to be updated. [ 823.920026] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.920151] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.920212] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.920461] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.920580] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.920695] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6 is going to be updated. [ 823.946558] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.946728] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.946728] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.946919] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.947086] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.960947] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da75c38e-887c-4ea5-bd53-f17b356cd114 in Status: IN_PROGRESS for 2s [ 823.972347] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.972513] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.972602] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.972789] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.972929] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.974852] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.975206] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.975206] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.975312] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.975404] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.986912] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 in Status: IN_PROGRESS for 2s [ 823.988035] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6 in Status: IN_PROGRESS for 2s [ 823.988393] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.988393] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.988393] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.988540] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.988573] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.988677] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e is going to be updated. [ 824.019239] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.019386] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.019451] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.019674] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.019819] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.034310] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e in Status: IN_PROGRESS for 2s [ 824.234318] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 in Status: IN_PROGRESS for 4s [ 825.972661] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da75c38e-887c-4ea5-bd53-f17b356cd114 in Status: SUCCESS [ 825.973154] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da75c38e-887c-4ea5-bd53-f17b356cd114" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.973154] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da75c38e-887c-4ea5-bd53-f17b356cd114" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.973383] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da75c38e-887c-4ea5-bd53-f17b356cd114" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.973591] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.973755] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.973891] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.973965] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.974048] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.974142] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da75c38e-887c-4ea5-bd53-f17b356cd114" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.974294] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('da75c38e-887c-4ea5-bd53-f17b356cd114',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.975299] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da75c38e-887c-4ea5-bd53-f17b356cd114" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.975465] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da75c38e-887c-4ea5-bd53-f17b356cd114" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.975637] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.975765] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.975839] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.975980] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.976140] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.976195] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da75c38e-887c-4ea5-bd53-f17b356cd114',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.000154] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6 in Status: SUCCESS [ 826.000398] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.001161] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 in Status: SUCCESS [ 826.001331] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.001487] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.001693] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.001900] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.002095] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.002238] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.002405] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.002599] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.002763] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.002835] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.003695] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.003875] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.004062] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.004269] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.004269] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.004532] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.004532] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.004532] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.004723] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b60bf9ef-6e65-4c6d-87e2-33b6bcafa939',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.005392] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.005606] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.005701] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.005945] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.005945] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.006056] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.006397] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.006397] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.007729] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.007958] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.008185] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.008267] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.008307] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.008492] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.008739] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.008877] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b60bf9ef-6e65-4c6d-87e2-33b6bcafa939',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.046375] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e in Status: SUCCESS [ 826.046627] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.046850] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.048047] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.048047] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.048047] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.048047] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.048047] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.048047] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.048650] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.048650] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1c8a6eda-c0ec-4e25-8652-6acf3d57da4e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.244810] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 in Status: SUCCESS [ 826.244810] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.479873] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.480800] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.480800] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.480800] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.480800] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.480800] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.480800] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.481108] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.481108] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.481226] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.481316] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da75c38e-887c-4ea5-bd53-f17b356cd114 is going to be deleted. [ 826.482436] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('da75c38e-887c-4ea5-bd53-f17b356cd114',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.512395] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b60bf9ef-6e65-4c6d-87e2-33b6bcafa939',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.514466] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.514667] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.515262] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.516510] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.516634] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.516675] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.519061] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.519061] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.519061] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.519061] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.519061] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.519061] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.519061] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.519061] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6 is going to be updated. [ 826.520891] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.521066] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.521129] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.521297] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.521380] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.522209] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da75c38e-887c-4ea5-bd53-f17b356cd114" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.546266] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.546486] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.546580] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.546778] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.546859] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.550496] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.550661] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.550723] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.551785] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.551785] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.551785] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.551785] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.551785] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.551785] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.551785] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.551785] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.552212] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.552212] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.552212] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.552305] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.552352] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.553196] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.553196] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.553196] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.553196] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.553196] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1c8a6eda-c0ec-4e25-8652-6acf3d57da4e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.559069] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6 in Status: IN_PROGRESS for 2s [ 826.985930] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for da75c38e-887c-4ea5-bd53-f17b356cd114: rpc.has_security_group_logging(os_id): False [ 827.008292] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.008541] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.008541] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.009341] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.009688] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.010224] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.010397] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.010510] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.010873] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.011023] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.011230] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da75c38e-887c-4ea5-bd53-f17b356cd114 is going to be created. [ 827.016696] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b60bf9ef-6e65-4c6d-87e2-33b6bcafa939',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.023089] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6: rpc.has_security_group_logging(os_id): False [ 827.036516] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/da75c38e-887c-4ea5-bd53-f17b356cd114], does not exist path=[/infra/domains/default/groups/da75c38e-887c-4ea5-bd53-f17b356cd114]."\n}' [ 827.036761] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da75c38e-887c-4ea5-bd53-f17b356cd114 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/da75c38e-887c-4ea5-bd53-f17b356cd114 [ 827.036846] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 827.045649] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.045944] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.045944] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.046141] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.046239] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.046468] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.046608] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.046608] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.046765] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.046829] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.046913] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6 is going to be updated. [ 827.055065] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e: rpc.has_security_group_logging(os_id): False [ 827.082606] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.082882] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.082882] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.083103] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.083934] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.084337] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.084589] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.084589] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.084857] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.084857] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.084981] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.085102] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.085162] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.085295] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.085372] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.085450] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da75c38e-887c-4ea5-bd53-f17b356cd114 is going to be created. [ 827.087825] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.087970] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.088033] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.088223] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.109078] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/da75c38e-887c-4ea5-bd53-f17b356cd114], does not exist path=[/infra/domains/default/groups/da75c38e-887c-4ea5-bd53-f17b356cd114]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/da75c38e-887c-4ea5-bd53-f17b356cd114 [ 827.109078] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da75c38e-887c-4ea5-bd53-f17b356cd114" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.109078] env[65471]: Traceback (most recent call last): [ 827.109078] env[65471]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 827.109078] env[65471]: return func(*args, **kwargs) [ 827.109078] env[65471]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 827.109078] env[65471]: res.raise_for_status() [ 827.109078] env[65471]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 827.109078] env[65471]: raise HTTPError(http_error_msg, response=self) [ 827.109078] env[65471]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/da75c38e-887c-4ea5-bd53-f17b356cd114 [ 827.109078] env[65471]: During handling of the above exception, another exception occurred: [ 827.109078] env[65471]: Traceback (most recent call last): [ 827.109938] env[65471]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 827.109938] env[65471]: listener.cb(fileno) [ 827.109938] env[65471]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 827.109938] env[65471]: result = function(*args, **kwargs) [ 827.109938] env[65471]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 827.109938] env[65471]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 827.109938] env[65471]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 827.109938] env[65471]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 827.109938] env[65471]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 827.109938] env[65471]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 827.109938] env[65471]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 827.109938] env[65471]: res.raise_for_status() [ 827.109938] env[65471]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 827.109938] env[65471]: raise HTTPError(http_error_msg, response=self) [ 827.109938] env[65471]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/da75c38e-887c-4ea5-bd53-f17b356cd114 [ 827.109938] env[65471]: Removing descriptor: 57 [ 827.110666] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.110886] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.111017] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.111220] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.111517] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.111606] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.111826] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.111931] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.111990] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.112282] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.112381] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.112570] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.112665] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.112725] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.112885] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.112961] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.113200] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e is going to be updated. [ 827.122686] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.122877] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.122926] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.123148] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.123339] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.137704] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6 in Status: IN_PROGRESS for 2s [ 827.183459] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.183644] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.183727] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.184314] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.184314] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.199348] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e in Status: IN_PROGRESS for 2s [ 827.520431] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.520431] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.520431] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.520774] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.520774] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.520839] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 is going to be updated. [ 827.538288] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 827.538439] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=5 [ 827.560357] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.560357] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.560357] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.560357] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.560357] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.574709] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 in Status: IN_PROGRESS for 2s [ 828.572170] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6 in Status: SUCCESS [ 828.572469] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6 deletion is rescheduled due to dependency. [ 828.572677] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.154693] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6 in Status: SUCCESS [ 829.154961] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.217127] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e in Status: SUCCESS [ 829.217127] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.224803] env[65471]: INFO networking_nsxv3.common.synchronization [req-8508c761-7fe1-4de1-accf-5c7fff129321 req-ddb31990-b9a6-4ca1-aaeb-23e0602b97f5 tempest-ServersWithSpecificFlavorTestJSON-1911677354 tempest-ServersWithSpecificFlavorTestJSON-1911677354-project-member] Enqueued Resource ID: 57387769-3919-42b1-a3d7-3d45bcef516d with Priority: HIGHEST for action security_group_members [ 829.224803] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57387769-3919-42b1-a3d7-3d45bcef516d with Priority: HIGHEST for action security_group_members [ 829.224981] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-57387769-3919-42b1-a3d7-3d45bcef516d taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.224981] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57387769-3919-42b1-a3d7-3d45bcef516d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.225107] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57387769-3919-42b1-a3d7-3d45bcef516d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.228419] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57387769-3919-42b1-a3d7-3d45bcef516d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.228419] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.228419] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.228419] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.228419] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.228419] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.228419] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57387769-3919-42b1-a3d7-3d45bcef516d',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.569397] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock network-310 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.569596] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "network-310" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.569753] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "network-310" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.570150] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "network-310" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.570429] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.570583] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.570697] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.570920] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.571121] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.571333] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 829.571443] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 829.571547] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 829.571650] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 829.571753] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 829.571852] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 829.571976] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 829.584459] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 in Status: SUCCESS [ 829.584822] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.584822] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.585023] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.585450] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.585595] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.585662] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.585846] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.585945] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.586066] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.586344] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.586344] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.586548] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.586548] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.586645] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.586730] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.586785] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.586943] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.586984] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.587064] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.587169] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b60bf9ef-6e65-4c6d-87e2-33b6bcafa939',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.593549] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 829.593726] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 829.593863] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 829.594035] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "network-310" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.594326] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock port-dc429125-d6b2-4102-8462-2e00097def15 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.594486] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "port-dc429125-d6b2-4102-8462-2e00097def15" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.594598] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "port-dc429125-d6b2-4102-8462-2e00097def15" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.594877] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "port-dc429125-d6b2-4102-8462-2e00097def15" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.595019] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc429125-d6b2-4102-8462-2e00097def15',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.731039] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.731286] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.731351] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.731583] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.752643] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.752969] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.754684] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.754831] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.755073] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.755167] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.755272] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57387769-3919-42b1-a3d7-3d45bcef516d is going to be updated. [ 829.781871] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.782169] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.782269] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.782517] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.782742] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.795168] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57387769-3919-42b1-a3d7-3d45bcef516d in Status: IN_PROGRESS for 2s [ 830.090049] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b60bf9ef-6e65-4c6d-87e2-33b6bcafa939: rpc.has_security_group_logging(os_id): False [ 830.097835] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.098135] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.098278] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.098559] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.098718] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.098869] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Segment Port dc429125-d6b2-4102-8462-2e00097def15 not found, creating... [ 830.099252] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.099416] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.099531] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.099746] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.099881] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.100264] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.100458] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.100458] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.100632] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.100755] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.100886] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Resource: SegmentPort with ID: dc429125-d6b2-4102-8462-2e00097def15 is going to be created. [ 830.108087] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.108269] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.108269] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.108457] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.124979] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.125215] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.125329] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.125707] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.125945] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.126189] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "port-dc429125-d6b2-4102-8462-2e00097def15" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.131167] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.131498] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.131698] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.131698] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.131900] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.131970] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.132385] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.132385] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.132488] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.132581] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.132811] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.132863] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.132948] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.132994] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.133126] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.133199] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.133284] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 is going to be updated. [ 830.200359] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.200528] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.200577] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.200795] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.200936] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.269860] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 in Status: IN_PROGRESS for 2s [ 830.820519] env[65471]: INFO networking_nsxv3.common.synchronization [req-8508c761-7fe1-4de1-accf-5c7fff129321 req-e9a0cefe-714f-4028-b81f-5107713eec41 service nova] Enqueued Resource ID: 57387769-3919-42b1-a3d7-3d45bcef516d with Priority: HIGHEST for action security_group_rules [ 830.820519] env[65471]: INFO networking_nsxv3.common.synchronization [req-8508c761-7fe1-4de1-accf-5c7fff129321 req-e9a0cefe-714f-4028-b81f-5107713eec41 service nova] Enqueued Resource ID: 57387769-3919-42b1-a3d7-3d45bcef516d with Priority: HIGHEST for action security_group_members [ 830.821458] env[65471]: INFO networking_nsxv3.common.synchronization [req-8508c761-7fe1-4de1-accf-5c7fff129321 req-e9a0cefe-714f-4028-b81f-5107713eec41 service nova] Enqueued Resource ID: dc429125-d6b2-4102-8462-2e00097def15 with Priority: HIGHEST for action port [ 830.821458] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57387769-3919-42b1-a3d7-3d45bcef516d with Priority: HIGHEST for action security_group_rules [ 830.821458] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57387769-3919-42b1-a3d7-3d45bcef516d with Priority: HIGHEST for action security_group_members [ 830.821563] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc429125-d6b2-4102-8462-2e00097def15 with Priority: HIGHEST for action port [ 830.821863] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57387769-3919-42b1-a3d7-3d45bcef516d taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.822055] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57387769-3919-42b1-a3d7-3d45bcef516d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.822105] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57387769-3919-42b1-a3d7-3d45bcef516d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.822305] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57387769-3919-42b1-a3d7-3d45bcef516d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.822414] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57387769-3919-42b1-a3d7-3d45bcef516d',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.823421] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-57387769-3919-42b1-a3d7-3d45bcef516d taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.823517] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57387769-3919-42b1-a3d7-3d45bcef516d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.823729] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-dc429125-d6b2-4102-8462-2e00097def15 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.823843] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dc429125-d6b2-4102-8462-2e00097def15" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.824708] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dc429125-d6b2-4102-8462-2e00097def15" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.824708] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dc429125-d6b2-4102-8462-2e00097def15" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.824708] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc429125-d6b2-4102-8462-2e00097def15',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.327163] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-57387769-3919-42b1-a3d7-3d45bcef516d taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.327318] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57387769-3919-42b1-a3d7-3d45bcef516d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.327502] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dc429125-d6b2-4102-8462-2e00097def15 with status ACTIVE [ 831.327679] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.327795] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.327856] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.328078] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.328169] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.328353] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.328436] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.328499] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.328646] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.328720] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.328905] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.329024] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.329135] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.329240] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.329334] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.329390] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dc429125-d6b2-4102-8462-2e00097def15 is going to be updated. [ 831.355104] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.355276] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.355331] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.355517] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.355651] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.355816] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dc429125-d6b2-4102-8462-2e00097def15" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.807295] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57387769-3919-42b1-a3d7-3d45bcef516d in Status: SUCCESS [ 831.807478] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57387769-3919-42b1-a3d7-3d45bcef516d deletion is rescheduled due to dependency. [ 831.807591] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57387769-3919-42b1-a3d7-3d45bcef516d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.807756] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57387769-3919-42b1-a3d7-3d45bcef516d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.807975] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57387769-3919-42b1-a3d7-3d45bcef516d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.808172] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.808540] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.808540] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.808540] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.808540] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.808813] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57387769-3919-42b1-a3d7-3d45bcef516d',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.294777] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 in Status: SUCCESS [ 832.295255] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.311676] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57387769-3919-42b1-a3d7-3d45bcef516d',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.814461] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57387769-3919-42b1-a3d7-3d45bcef516d',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.317656] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.317990] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.317990] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.319226] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.319226] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.319226] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57387769-3919-42b1-a3d7-3d45bcef516d is going to be updated. [ 833.360483] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.360483] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.360483] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.360483] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.360483] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.370643] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57387769-3919-42b1-a3d7-3d45bcef516d in Status: IN_PROGRESS for 2s [ 833.812484] env[65471]: INFO networking_nsxv3.common.synchronization [req-abd41948-d5e1-49af-bd76-c85a018f4523 req-e7cbb191-3a3e-42f5-9377-0343eacbb8b8 tempest-ServerRescueTestJSON-1224779364 tempest-ServerRescueTestJSON-1224779364-project-member] Enqueued Resource ID: a70c8576-d6c6-406f-8ebf-d5fb66c56b95 with Priority: HIGHEST for action security_group_members [ 833.813182] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a70c8576-d6c6-406f-8ebf-d5fb66c56b95 with Priority: HIGHEST for action security_group_members [ 833.813696] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-a70c8576-d6c6-406f-8ebf-d5fb66c56b95 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.814887] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a70c8576-d6c6-406f-8ebf-d5fb66c56b95" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.815047] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a70c8576-d6c6-406f-8ebf-d5fb66c56b95" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.815367] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a70c8576-d6c6-406f-8ebf-d5fb66c56b95" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.815579] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.815714] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.815879] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.816088] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.817152] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.817152] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a70c8576-d6c6-406f-8ebf-d5fb66c56b95',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.230923] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock network-187 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.230923] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "network-187" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.231242] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "network-187" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.231625] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "network-187" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.231708] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.231849] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.231901] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.232138] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.232309] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.232521] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 834.232627] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 834.232730] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 834.232833] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 834.233078] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 834.233078] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 834.233173] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 834.258504] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 834.258777] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 834.259173] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 834.259173] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "network-187" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.259496] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock port-3312ed61-1354-4d7f-a684-5b232befb22f taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.259800] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "port-3312ed61-1354-4d7f-a684-5b232befb22f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.259800] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "port-3312ed61-1354-4d7f-a684-5b232befb22f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.260113] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "port-3312ed61-1354-4d7f-a684-5b232befb22f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.260256] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3312ed61-1354-4d7f-a684-5b232befb22f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.319954] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.320301] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.320301] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.320454] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.320606] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.320918] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.321061] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.321185] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.321382] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.321518] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.321635] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a70c8576-d6c6-406f-8ebf-d5fb66c56b95 already deleted. [ 834.321750] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a70c8576-d6c6-406f-8ebf-d5fb66c56b95" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.690871] env[65471]: INFO networking_nsxv3.common.synchronization [req-2591e03d-012e-4858-bd0b-04ad99be09c7 req-81ea1dce-5574-4bbe-8641-d19b4101abb9 tempest-ImagesTestJSON-650286870 tempest-ImagesTestJSON-650286870-project-member] Enqueued Resource ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f with Priority: HIGHEST for action security_group_members [ 834.690871] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f with Priority: HIGHEST for action security_group_members [ 834.690871] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-85af6c5e-2f9b-491d-9584-96c44b20f99f taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.690871] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.690871] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.690871] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.691512] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.692897] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.692897] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.692897] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.692897] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.692897] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85af6c5e-2f9b-491d-9584-96c44b20f99f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.763279] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.763577] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.763748] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.764076] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.764267] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.764453] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Segment Port 3312ed61-1354-4d7f-a684-5b232befb22f not found, creating... [ 834.764740] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.764944] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.765108] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.765347] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.765484] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.765860] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.766055] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.766195] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.766433] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.766567] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.766720] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Resource: SegmentPort with ID: 3312ed61-1354-4d7f-a684-5b232befb22f is going to be created. [ 834.789939] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.789939] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.789939] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.790397] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.790397] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.790460] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "port-3312ed61-1354-4d7f-a684-5b232befb22f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.000866] env[65471]: INFO networking_nsxv3.common.synchronization [req-24531b7e-5dd3-4317-b85c-0eee0b3bb16f req-8e80a50d-eab2-4f5b-bf89-0add93239265 tempest-ServersTestManualDisk-1928283683 tempest-ServersTestManualDisk-1928283683-project-member] Enqueued Resource ID: cd8e3453-8620-4f9d-b764-155e97a20205 with Priority: HIGHEST for action security_group_members [ 835.001679] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd8e3453-8620-4f9d-b764-155e97a20205 with Priority: HIGHEST for action security_group_members [ 835.002558] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd8e3453-8620-4f9d-b764-155e97a20205 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.004026] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd8e3453-8620-4f9d-b764-155e97a20205" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.004026] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd8e3453-8620-4f9d-b764-155e97a20205" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.004026] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd8e3453-8620-4f9d-b764-155e97a20205" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.004026] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.004026] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.004026] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.004026] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.004026] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.004558] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd8e3453-8620-4f9d-b764-155e97a20205',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.196716] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.196716] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.196716] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.196716] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.219192] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.220070] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.220070] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.220070] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.220070] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.220070] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.220070] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f is going to be updated. [ 835.254498] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.254498] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.254498] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.254498] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.254498] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.268640] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f in Status: IN_PROGRESS for 2s [ 835.383265] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57387769-3919-42b1-a3d7-3d45bcef516d in Status: SUCCESS [ 835.383605] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57387769-3919-42b1-a3d7-3d45bcef516d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.383676] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57387769-3919-42b1-a3d7-3d45bcef516d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.383893] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57387769-3919-42b1-a3d7-3d45bcef516d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.384110] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.384237] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.384297] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.385109] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.385109] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.385109] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57387769-3919-42b1-a3d7-3d45bcef516d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.385109] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('57387769-3919-42b1-a3d7-3d45bcef516d',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.506873] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.507057] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.507130] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.508142] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.529348] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.529608] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.529726] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.529794] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.529985] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.530177] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.530275] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd8e3453-8620-4f9d-b764-155e97a20205 is going to be updated. [ 835.554597] env[65471]: INFO networking_nsxv3.common.synchronization [req-abd41948-d5e1-49af-bd76-c85a018f4523 req-e8833417-d051-4020-9418-0236a0b7c282 service nova] Enqueued Resource ID: a70c8576-d6c6-406f-8ebf-d5fb66c56b95 with Priority: HIGHEST for action security_group_rules [ 835.554757] env[65471]: INFO networking_nsxv3.common.synchronization [req-abd41948-d5e1-49af-bd76-c85a018f4523 req-e8833417-d051-4020-9418-0236a0b7c282 service nova] Enqueued Resource ID: a70c8576-d6c6-406f-8ebf-d5fb66c56b95 with Priority: HIGHEST for action security_group_members [ 835.554894] env[65471]: INFO networking_nsxv3.common.synchronization [req-abd41948-d5e1-49af-bd76-c85a018f4523 req-e8833417-d051-4020-9418-0236a0b7c282 service nova] Enqueued Resource ID: 3312ed61-1354-4d7f-a684-5b232befb22f with Priority: HIGHEST for action port [ 835.555826] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a70c8576-d6c6-406f-8ebf-d5fb66c56b95 with Priority: HIGHEST for action security_group_rules [ 835.555988] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a70c8576-d6c6-406f-8ebf-d5fb66c56b95 with Priority: HIGHEST for action security_group_members [ 835.556108] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3312ed61-1354-4d7f-a684-5b232befb22f with Priority: HIGHEST for action port [ 835.557971] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.558107] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.558174] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.558510] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.559023] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.559779] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a70c8576-d6c6-406f-8ebf-d5fb66c56b95 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.559892] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a70c8576-d6c6-406f-8ebf-d5fb66c56b95" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.559996] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a70c8576-d6c6-406f-8ebf-d5fb66c56b95" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.560172] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a70c8576-d6c6-406f-8ebf-d5fb66c56b95" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.560828] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a70c8576-d6c6-406f-8ebf-d5fb66c56b95',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.561093] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-a70c8576-d6c6-406f-8ebf-d5fb66c56b95 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.561230] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a70c8576-d6c6-406f-8ebf-d5fb66c56b95" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.561274] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a70c8576-d6c6-406f-8ebf-d5fb66c56b95" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.561420] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a70c8576-d6c6-406f-8ebf-d5fb66c56b95" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.561567] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.561651] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.561754] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.561831] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.561900] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.561979] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a70c8576-d6c6-406f-8ebf-d5fb66c56b95',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.562747] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-3312ed61-1354-4d7f-a684-5b232befb22f taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.562856] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3312ed61-1354-4d7f-a684-5b232befb22f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.562899] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3312ed61-1354-4d7f-a684-5b232befb22f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.563080] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3312ed61-1354-4d7f-a684-5b232befb22f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.563136] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3312ed61-1354-4d7f-a684-5b232befb22f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.579922] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd8e3453-8620-4f9d-b764-155e97a20205 in Status: IN_PROGRESS for 2s [ 835.890446] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('57387769-3919-42b1-a3d7-3d45bcef516d',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.067896] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3312ed61-1354-4d7f-a684-5b232befb22f with status ACTIVE [ 836.068410] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.068704] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.068804] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.069481] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.069481] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.069481] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.069765] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.069765] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.069868] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.069868] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.070072] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.070184] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.070278] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.070813] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.070813] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.070813] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3312ed61-1354-4d7f-a684-5b232befb22f is going to be updated. [ 836.071920] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a70c8576-d6c6-406f-8ebf-d5fb66c56b95',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.073014] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-a70c8576-d6c6-406f-8ebf-d5fb66c56b95 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.073219] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a70c8576-d6c6-406f-8ebf-d5fb66c56b95" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.095613] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.096152] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.096152] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.096258] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.096465] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.096692] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3312ed61-1354-4d7f-a684-5b232befb22f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.393755] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 57387769-3919-42b1-a3d7-3d45bcef516d: rpc.has_security_group_logging(os_id): False [ 836.414013] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.414190] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.414257] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.414459] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.414582] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.414872] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.414985] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.415064] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.415223] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.415321] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.415468] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57387769-3919-42b1-a3d7-3d45bcef516d is going to be updated. [ 836.486190] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.486443] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.486577] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.486987] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.487181] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.503432] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57387769-3919-42b1-a3d7-3d45bcef516d in Status: IN_PROGRESS for 2s [ 836.575180] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a70c8576-d6c6-406f-8ebf-d5fb66c56b95',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.078588] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.078793] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.078849] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.079102] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.079201] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.079307] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a70c8576-d6c6-406f-8ebf-d5fb66c56b95 is going to be created. [ 837.103177] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.103381] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.103381] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.103604] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.104399] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.116333] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a70c8576-d6c6-406f-8ebf-d5fb66c56b95 in Status: UNINITIALIZED for 2s [ 837.277739] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f in Status: SUCCESS [ 837.277933] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f deletion is rescheduled due to dependency. [ 837.278066] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.591242] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd8e3453-8620-4f9d-b764-155e97a20205 in Status: SUCCESS [ 837.591624] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd8e3453-8620-4f9d-b764-155e97a20205 deletion is rescheduled due to dependency. [ 837.591714] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd8e3453-8620-4f9d-b764-155e97a20205" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.521036] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57387769-3919-42b1-a3d7-3d45bcef516d in Status: SUCCESS [ 838.521036] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57387769-3919-42b1-a3d7-3d45bcef516d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.604807] env[65471]: INFO networking_nsxv3.common.synchronization [req-3a251543-82f2-4fc5-ae0a-9881bb847c27 req-20e703e0-bb75-416d-856f-cb0ca01a3d78 tempest-ImagesOneServerNegativeTestJSON-124059679 tempest-ImagesOneServerNegativeTestJSON-124059679-project-member] Enqueued Resource ID: a3c5f688-9271-4722-84e9-69667c674933 with Priority: HIGHEST for action security_group_members [ 838.605472] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3c5f688-9271-4722-84e9-69667c674933 with Priority: HIGHEST for action security_group_members [ 838.605779] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3c5f688-9271-4722-84e9-69667c674933 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.605920] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.605991] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.606202] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.606374] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.606471] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.606545] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.606724] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.606865] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.606995] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a3c5f688-9271-4722-84e9-69667c674933',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.923444] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock network-16 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.923698] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "network-16" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.923831] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "network-16" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.924151] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "network-16" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.924785] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.924949] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.925168] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.925560] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.925663] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.925787] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 838.925941] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 838.926315] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 838.926315] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 838.926315] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 838.926558] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 838.926558] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 838.949156] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 838.949156] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 838.949251] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 838.949798] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "network-16" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.949798] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock port-9488edd0-e9bb-454e-924a-d9e6830aecbb taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.949976] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "port-9488edd0-e9bb-454e-924a-d9e6830aecbb" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.949976] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "port-9488edd0-e9bb-454e-924a-d9e6830aecbb" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.950305] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "port-9488edd0-e9bb-454e-924a-d9e6830aecbb" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.950432] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9488edd0-e9bb-454e-924a-d9e6830aecbb',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.109397] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.109484] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.109523] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.109845] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.109845] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.110252] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.110252] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.110252] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.110413] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.110413] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.110672] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3c5f688-9271-4722-84e9-69667c674933 is going to be deleted. [ 839.124745] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a70c8576-d6c6-406f-8ebf-d5fb66c56b95 in Status: SUCCESS [ 839.124970] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a70c8576-d6c6-406f-8ebf-d5fb66c56b95" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.125148] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a70c8576-d6c6-406f-8ebf-d5fb66c56b95" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.125363] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a70c8576-d6c6-406f-8ebf-d5fb66c56b95" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.125559] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.125665] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.125720] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.125875] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.125976] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.126087] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a70c8576-d6c6-406f-8ebf-d5fb66c56b95" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.126198] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a70c8576-d6c6-406f-8ebf-d5fb66c56b95',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.139511] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.139779] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.139944] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.140313] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.140521] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.140752] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.453769] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.454141] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.454605] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.454985] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.455254] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.455518] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Segment Port 9488edd0-e9bb-454e-924a-d9e6830aecbb not found, creating... [ 839.455960] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.457024] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.457024] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.457392] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.457392] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.457791] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.458087] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.458333] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.458636] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.459080] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.459304] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Resource: SegmentPort with ID: 9488edd0-e9bb-454e-924a-d9e6830aecbb is going to be created. [ 839.483670] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.484128] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.484419] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.484886] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.485477] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.485665] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "port-9488edd0-e9bb-454e-924a-d9e6830aecbb" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.629253] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-a70c8576-d6c6-406f-8ebf-d5fb66c56b95 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.629684] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a70c8576-d6c6-406f-8ebf-d5fb66c56b95" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.629684] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a70c8576-d6c6-406f-8ebf-d5fb66c56b95" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.629939] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a70c8576-d6c6-406f-8ebf-d5fb66c56b95" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.630263] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.630449] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.630574] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.630863] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.631033] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.631271] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a70c8576-d6c6-406f-8ebf-d5fb66c56b95" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.631519] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-a70c8576-d6c6-406f-8ebf-d5fb66c56b95 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.631714] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a70c8576-d6c6-406f-8ebf-d5fb66c56b95" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.631834] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a70c8576-d6c6-406f-8ebf-d5fb66c56b95" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.632109] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a70c8576-d6c6-406f-8ebf-d5fb66c56b95" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.632370] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.632560] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.632693] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.632938] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.633098] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.633252] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a70c8576-d6c6-406f-8ebf-d5fb66c56b95" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.633422] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a70c8576-d6c6-406f-8ebf-d5fb66c56b95',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.136272] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a70c8576-d6c6-406f-8ebf-d5fb66c56b95: rpc.has_security_group_logging(os_id): False [ 840.162052] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.162256] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.162357] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.162738] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.162869] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.163129] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.163271] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.163369] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.163586] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.163684] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.164572] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.164707] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.164790] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.165012] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.165177] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.165496] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.166135] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.166302] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.166645] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.166706] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.166805] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a70c8576-d6c6-406f-8ebf-d5fb66c56b95 is going to be created. [ 840.260998] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.263108] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.263263] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.263600] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.263894] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.282285] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a70c8576-d6c6-406f-8ebf-d5fb66c56b95 in Status: IN_PROGRESS for 2s [ 840.313740] env[65471]: INFO networking_nsxv3.common.synchronization [req-3a251543-82f2-4fc5-ae0a-9881bb847c27 req-e3be92cf-bcfb-44ab-8850-44952a3036cd service nova] Enqueued Resource ID: a3c5f688-9271-4722-84e9-69667c674933 with Priority: HIGHEST for action security_group_rules [ 840.314010] env[65471]: INFO networking_nsxv3.common.synchronization [req-3a251543-82f2-4fc5-ae0a-9881bb847c27 req-e3be92cf-bcfb-44ab-8850-44952a3036cd service nova] Enqueued Resource ID: a3c5f688-9271-4722-84e9-69667c674933 with Priority: HIGHEST for action security_group_members [ 840.314289] env[65471]: INFO networking_nsxv3.common.synchronization [req-3a251543-82f2-4fc5-ae0a-9881bb847c27 req-e3be92cf-bcfb-44ab-8850-44952a3036cd service nova] Enqueued Resource ID: 9488edd0-e9bb-454e-924a-d9e6830aecbb with Priority: HIGHEST for action port [ 840.314895] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3c5f688-9271-4722-84e9-69667c674933 with Priority: HIGHEST for action security_group_rules [ 840.315076] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3c5f688-9271-4722-84e9-69667c674933 with Priority: HIGHEST for action security_group_members [ 840.315183] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9488edd0-e9bb-454e-924a-d9e6830aecbb with Priority: HIGHEST for action port [ 840.315510] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a3c5f688-9271-4722-84e9-69667c674933 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.315633] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.315704] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.315908] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.315990] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a3c5f688-9271-4722-84e9-69667c674933',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.318582] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3c5f688-9271-4722-84e9-69667c674933 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.318699] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.318699] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.318881] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.319082] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.319133] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.319246] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.319377] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.319464] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.319561] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a3c5f688-9271-4722-84e9-69667c674933',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.321638] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-9488edd0-e9bb-454e-924a-d9e6830aecbb taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.321638] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9488edd0-e9bb-454e-924a-d9e6830aecbb" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.321638] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9488edd0-e9bb-454e-924a-d9e6830aecbb" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.321638] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9488edd0-e9bb-454e-924a-d9e6830aecbb" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.321638] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9488edd0-e9bb-454e-924a-d9e6830aecbb',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.823017] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a3c5f688-9271-4722-84e9-69667c674933',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.823892] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3c5f688-9271-4722-84e9-69667c674933 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.823997] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.824184] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9488edd0-e9bb-454e-924a-d9e6830aecbb with status ACTIVE [ 840.824395] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.824501] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.824682] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.824898] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.824985] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.825936] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.825936] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.825936] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.825936] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.825936] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.825936] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.825936] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.825936] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.826436] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.826436] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.826436] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9488edd0-e9bb-454e-924a-d9e6830aecbb is going to be updated. [ 840.872276] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.872493] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.872539] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.872776] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.872918] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.873125] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9488edd0-e9bb-454e-924a-d9e6830aecbb" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.328118] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a3c5f688-9271-4722-84e9-69667c674933',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.832296] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.832623] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.832718] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.835464] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.835464] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.835464] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3c5f688-9271-4722-84e9-69667c674933 is going to be created. [ 841.863938] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.867140] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.867140] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.867140] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.867140] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.879018] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3c5f688-9271-4722-84e9-69667c674933 in Status: UNINITIALIZED for 2s [ 842.324914] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a70c8576-d6c6-406f-8ebf-d5fb66c56b95 in Status: SUCCESS [ 842.325175] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a70c8576-d6c6-406f-8ebf-d5fb66c56b95" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.889967] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3c5f688-9271-4722-84e9-69667c674933 in Status: SUCCESS [ 843.890376] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.890749] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.891059] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.891699] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.891699] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.891699] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.891699] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.891699] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.892084] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.892084] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a3c5f688-9271-4722-84e9-69667c674933',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.394081] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3c5f688-9271-4722-84e9-69667c674933 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.394232] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.394495] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.394563] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.394699] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.394820] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.394886] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.395049] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.395132] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.395218] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.395373] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3c5f688-9271-4722-84e9-69667c674933 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.395473] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.395526] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.395659] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.395797] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.395886] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.395946] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.396110] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.396184] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.396263] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.396388] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a3c5f688-9271-4722-84e9-69667c674933',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.487452] env[65471]: INFO networking_nsxv3.common.synchronization [req-a150fb77-1805-4431-b167-ab3a88d33931 req-6f6bab6c-6057-45f5-9ae2-dead0f19a373 tempest-ServerGroupTestJSON-2115080229 tempest-ServerGroupTestJSON-2115080229-project-member] Enqueued Resource ID: 44a00269-8b59-46f1-9a1e-09081fed9489 with Priority: HIGHEST for action security_group_members [ 844.487740] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44a00269-8b59-46f1-9a1e-09081fed9489 with Priority: HIGHEST for action security_group_members [ 844.488105] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-44a00269-8b59-46f1-9a1e-09081fed9489 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.488239] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44a00269-8b59-46f1-9a1e-09081fed9489" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.488306] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44a00269-8b59-46f1-9a1e-09081fed9489" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.488550] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44a00269-8b59-46f1-9a1e-09081fed9489" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.488775] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.488890] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.488978] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.489325] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.489483] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.489590] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44a00269-8b59-46f1-9a1e-09081fed9489',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.899085] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a3c5f688-9271-4722-84e9-69667c674933: rpc.has_security_group_logging(os_id): False [ 844.913787] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock network-915 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.914043] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "network-915" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.914199] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "network-915" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.914578] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "network-915" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.914891] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.915094] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.915248] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.915512] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.915706] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.915957] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 844.916319] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 844.916319] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 844.916319] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 844.916501] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 844.916581] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 844.916742] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 844.919172] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.919325] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.919411] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.919594] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.919681] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.919886] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.919977] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.920051] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.920195] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.920271] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.920443] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.920534] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.920593] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.920727] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.920791] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.920976] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.921114] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.921232] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.921361] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.921436] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.921521] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a3c5f688-9271-4722-84e9-69667c674933 is going to be created. [ 844.944917] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 844.945223] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 844.945374] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 844.945575] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "network-915" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.945919] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock port-7ff16855-6822-481c-af30-bb6ee9dec03c taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.946159] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "port-7ff16855-6822-481c-af30-bb6ee9dec03c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.946316] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "port-7ff16855-6822-481c-af30-bb6ee9dec03c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.946628] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "port-7ff16855-6822-481c-af30-bb6ee9dec03c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.946764] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ff16855-6822-481c-af30-bb6ee9dec03c',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.992649] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.993040] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.993205] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.993406] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.993502] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.993734] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.993841] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.993905] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.994076] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.994150] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.994236] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44a00269-8b59-46f1-9a1e-09081fed9489 already deleted. [ 844.994316] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44a00269-8b59-46f1-9a1e-09081fed9489" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.995383] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.995491] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.995558] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.995879] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.996103] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.011587] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a3c5f688-9271-4722-84e9-69667c674933 in Status: IN_PROGRESS for 2s [ 845.449757] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.450094] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.450233] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.450539] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.450709] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.450866] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Segment Port 7ff16855-6822-481c-af30-bb6ee9dec03c not found, creating... [ 845.451198] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.451412] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.451528] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.451753] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.451892] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.452201] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.452707] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.454207] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.454489] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.454701] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.454882] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Resource: SegmentPort with ID: 7ff16855-6822-481c-af30-bb6ee9dec03c is going to be created. [ 845.481439] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.481821] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.481956] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.482349] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.483060] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.483060] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "port-7ff16855-6822-481c-af30-bb6ee9dec03c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.627588] env[65471]: INFO networking_nsxv3.common.synchronization [req-1ef4f7ed-2236-41eb-9dad-801d786b1613 req-eaaf62c6-5d75-4b7a-a56d-1f3a85360397 tempest-ServerDiskConfigTestJSON-1443816332 tempest-ServerDiskConfigTestJSON-1443816332-project-member] Enqueued Resource ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e with Priority: HIGHEST for action security_group_members [ 845.627760] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e with Priority: HIGHEST for action security_group_members [ 845.628091] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.628225] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.628296] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.628518] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.628687] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.628789] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.628851] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.629013] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.629111] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.629225] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c8a6eda-c0ec-4e25-8652-6acf3d57da4e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.132166] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.132460] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.132460] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.132619] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.132712] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.132912] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.133024] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.133078] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.133621] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.133621] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.133621] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e is going to be updated. [ 846.168666] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.168911] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.168991] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.169337] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.169532] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.179931] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e in Status: IN_PROGRESS for 2s [ 846.223592] env[65471]: INFO networking_nsxv3.common.synchronization [req-a150fb77-1805-4431-b167-ab3a88d33931 req-d40c375b-f555-406e-87a9-f999c07e0907 service nova] Enqueued Resource ID: 44a00269-8b59-46f1-9a1e-09081fed9489 with Priority: HIGHEST for action security_group_rules [ 846.223592] env[65471]: INFO networking_nsxv3.common.synchronization [req-a150fb77-1805-4431-b167-ab3a88d33931 req-d40c375b-f555-406e-87a9-f999c07e0907 service nova] Enqueued Resource ID: 44a00269-8b59-46f1-9a1e-09081fed9489 with Priority: HIGHEST for action security_group_members [ 846.223762] env[65471]: INFO networking_nsxv3.common.synchronization [req-a150fb77-1805-4431-b167-ab3a88d33931 req-d40c375b-f555-406e-87a9-f999c07e0907 service nova] Enqueued Resource ID: 7ff16855-6822-481c-af30-bb6ee9dec03c with Priority: HIGHEST for action port [ 846.224903] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44a00269-8b59-46f1-9a1e-09081fed9489 with Priority: HIGHEST for action security_group_rules [ 846.224903] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44a00269-8b59-46f1-9a1e-09081fed9489 with Priority: HIGHEST for action security_group_members [ 846.224903] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ff16855-6822-481c-af30-bb6ee9dec03c with Priority: HIGHEST for action port [ 846.224903] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-44a00269-8b59-46f1-9a1e-09081fed9489 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.224903] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-44a00269-8b59-46f1-9a1e-09081fed9489" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.224903] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-44a00269-8b59-46f1-9a1e-09081fed9489" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.225257] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-44a00269-8b59-46f1-9a1e-09081fed9489" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.225257] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('44a00269-8b59-46f1-9a1e-09081fed9489',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.226074] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-44a00269-8b59-46f1-9a1e-09081fed9489 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.226450] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44a00269-8b59-46f1-9a1e-09081fed9489" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.226450] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44a00269-8b59-46f1-9a1e-09081fed9489" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.226556] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44a00269-8b59-46f1-9a1e-09081fed9489" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.226665] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.226762] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.226824] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.226964] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.227060] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.227998] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44a00269-8b59-46f1-9a1e-09081fed9489',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.227998] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ff16855-6822-481c-af30-bb6ee9dec03c taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.227998] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ff16855-6822-481c-af30-bb6ee9dec03c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.228519] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ff16855-6822-481c-af30-bb6ee9dec03c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.228519] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ff16855-6822-481c-af30-bb6ee9dec03c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.228519] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ff16855-6822-481c-af30-bb6ee9dec03c',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.730364] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7ff16855-6822-481c-af30-bb6ee9dec03c with status ACTIVE [ 846.730671] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.730777] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.730842] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.731073] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.731164] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.731722] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.731722] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.731722] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.731882] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.731882] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.732030] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.732137] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.732222] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.732847] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.732847] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.732847] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7ff16855-6822-481c-af30-bb6ee9dec03c is going to be updated. [ 846.733999] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-44a00269-8b59-46f1-9a1e-09081fed9489 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.734149] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44a00269-8b59-46f1-9a1e-09081fed9489" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.734389] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('44a00269-8b59-46f1-9a1e-09081fed9489',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.758792] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.759054] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.759109] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.759356] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.759568] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.759770] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ff16855-6822-481c-af30-bb6ee9dec03c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.028880] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a3c5f688-9271-4722-84e9-69667c674933 in Status: SUCCESS [ 847.029060] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.237515] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('44a00269-8b59-46f1-9a1e-09081fed9489',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.740833] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.740833] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.740833] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.741164] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.741164] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.741311] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44a00269-8b59-46f1-9a1e-09081fed9489 is going to be created. [ 847.771728] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.771728] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.771728] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.771728] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.771728] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.780804] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44a00269-8b59-46f1-9a1e-09081fed9489 in Status: UNINITIALIZED for 2s [ 848.192938] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e in Status: SUCCESS [ 848.195769] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e deletion is rescheduled due to dependency. [ 848.195769] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.794770] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44a00269-8b59-46f1-9a1e-09081fed9489 in Status: SUCCESS [ 849.794770] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44a00269-8b59-46f1-9a1e-09081fed9489" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.794770] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44a00269-8b59-46f1-9a1e-09081fed9489" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.794770] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44a00269-8b59-46f1-9a1e-09081fed9489" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.794770] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.794770] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.794770] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.794770] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.794770] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.794770] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44a00269-8b59-46f1-9a1e-09081fed9489" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.794770] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('44a00269-8b59-46f1-9a1e-09081fed9489',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.299113] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-44a00269-8b59-46f1-9a1e-09081fed9489 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.299365] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44a00269-8b59-46f1-9a1e-09081fed9489" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.299439] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44a00269-8b59-46f1-9a1e-09081fed9489" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.299655] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44a00269-8b59-46f1-9a1e-09081fed9489" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.300938] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.300938] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.300938] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.300938] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.300938] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.300938] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44a00269-8b59-46f1-9a1e-09081fed9489" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.300938] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-44a00269-8b59-46f1-9a1e-09081fed9489 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.300938] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44a00269-8b59-46f1-9a1e-09081fed9489" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.300938] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44a00269-8b59-46f1-9a1e-09081fed9489" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.300938] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44a00269-8b59-46f1-9a1e-09081fed9489" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.300938] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.300938] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.301476] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.301476] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.301476] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.301476] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44a00269-8b59-46f1-9a1e-09081fed9489" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.301476] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('44a00269-8b59-46f1-9a1e-09081fed9489',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.806356] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 44a00269-8b59-46f1-9a1e-09081fed9489: rpc.has_security_group_logging(os_id): False [ 850.831813] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.832110] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.832234] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.832566] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.832723] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.835064] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.835064] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.835064] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.835413] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.835413] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.835639] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.835803] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.836067] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.836156] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.836287] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.836589] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.836744] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.836863] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.837108] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.837237] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.837376] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 44a00269-8b59-46f1-9a1e-09081fed9489 is going to be created. [ 850.937596] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.937784] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.937863] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.938078] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.938267] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.956354] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 44a00269-8b59-46f1-9a1e-09081fed9489 in Status: IN_PROGRESS for 2s [ 851.226993] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 851.227145] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 851.254332] env[65471]: INFO networking_nsxv3.common.synchronization [req-b06b310a-bd05-4217-b168-8adc4ac5fc21 req-b07db4f1-477b-47ad-bd55-ebb691f0f62e tempest-AttachVolumeNegativeTest-275281664 tempest-AttachVolumeNegativeTest-275281664-project-member] Enqueued Resource ID: 8a168c13-528b-4758-b139-f0aa310cde5c with Priority: HIGHEST for action security_group_members [ 851.254886] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a168c13-528b-4758-b139-f0aa310cde5c with Priority: HIGHEST for action security_group_members [ 851.255213] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a168c13-528b-4758-b139-f0aa310cde5c taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.255398] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a168c13-528b-4758-b139-f0aa310cde5c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.255479] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a168c13-528b-4758-b139-f0aa310cde5c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.255765] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a168c13-528b-4758-b139-f0aa310cde5c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.255959] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.257796] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.257901] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.259167] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.259167] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.259167] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a168c13-528b-4758-b139-f0aa310cde5c',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.644303] env[65471]: INFO networking_nsxv3.common.synchronization [req-6abb68b8-8a75-4832-84f2-b27d5300d9da req-2e984c7f-7fd1-452e-ae08-be3e9a12294d tempest-ServersTestBootFromVolume-1192670064 tempest-ServersTestBootFromVolume-1192670064-project-member] Enqueued Resource ID: 58316ca3-525d-4197-969c-1e363b6969c6 with Priority: HIGHEST for action security_group_members [ 851.645834] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58316ca3-525d-4197-969c-1e363b6969c6 with Priority: HIGHEST for action security_group_members [ 851.645834] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-58316ca3-525d-4197-969c-1e363b6969c6 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.646221] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58316ca3-525d-4197-969c-1e363b6969c6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.646410] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58316ca3-525d-4197-969c-1e363b6969c6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.646754] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58316ca3-525d-4197-969c-1e363b6969c6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.649279] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.649279] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.649279] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.649279] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.649279] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.649279] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58316ca3-525d-4197-969c-1e363b6969c6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.762898] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.762898] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.762898] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.762898] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.762898] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.762898] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.762898] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.762898] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.762898] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.762898] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.762898] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a168c13-528b-4758-b139-f0aa310cde5c already deleted. [ 851.762898] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a168c13-528b-4758-b139-f0aa310cde5c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.151796] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.152398] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.152398] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.152398] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.178112] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.178409] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.178727] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.178727] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.178892] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.178944] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.179023] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58316ca3-525d-4197-969c-1e363b6969c6 is going to be updated. [ 852.189588] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock network-507 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.189804] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "network-507" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.189931] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "network-507" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.190363] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "network-507" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.190657] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.190851] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.190967] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.191209] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.191438] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.191671] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 852.191781] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 852.192144] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 852.192144] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 852.192340] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 852.192340] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 852.192452] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 852.215453] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 852.215742] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 852.215970] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 852.216144] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "network-507" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.216727] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock port-2d97e2b3-6d10-4926-8da6-80eceaac5275 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.216921] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "port-2d97e2b3-6d10-4926-8da6-80eceaac5275" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.216921] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "port-2d97e2b3-6d10-4926-8da6-80eceaac5275" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.218188] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "port-2d97e2b3-6d10-4926-8da6-80eceaac5275" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.218363] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d97e2b3-6d10-4926-8da6-80eceaac5275',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.220608] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.220753] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.220753] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.220985] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.221405] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.232208] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58316ca3-525d-4197-969c-1e363b6969c6 in Status: IN_PROGRESS for 2s [ 852.727074] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.727074] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.727074] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.727074] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.727074] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.727074] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Segment Port 2d97e2b3-6d10-4926-8da6-80eceaac5275 not found, creating... [ 852.727074] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.727074] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.727074] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.727074] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.727074] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.727544] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.727544] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.727544] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.727544] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.727544] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.727544] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Resource: SegmentPort with ID: 2d97e2b3-6d10-4926-8da6-80eceaac5275 is going to be created. [ 852.747493] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.747761] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.747893] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.748190] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.748415] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.748630] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "port-2d97e2b3-6d10-4926-8da6-80eceaac5275" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.856430] env[65471]: INFO networking_nsxv3.common.synchronization [None req-e0dee381-bbdc-4bd9-9af0-4ffa5a2b4c27 None None] Enqueued Resource ID: cb0cef79-ce3d-459a-8722-0414fb5717bf with Priority: HIGHEST for action port [ 852.856995] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb0cef79-ce3d-459a-8722-0414fb5717bf with Priority: HIGHEST for action port [ 852.858597] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-cb0cef79-ce3d-459a-8722-0414fb5717bf taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.858734] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cb0cef79-ce3d-459a-8722-0414fb5717bf" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.858818] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cb0cef79-ce3d-459a-8722-0414fb5717bf" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.859104] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cb0cef79-ce3d-459a-8722-0414fb5717bf" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.859265] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb0cef79-ce3d-459a-8722-0414fb5717bf',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.975499] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 44a00269-8b59-46f1-9a1e-09081fed9489 in Status: SUCCESS [ 852.975650] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-44a00269-8b59-46f1-9a1e-09081fed9489" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.360931] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cb0cef79-ce3d-459a-8722-0414fb5717bf [ 853.361226] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.361453] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.361453] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.361664] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.361751] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.361851] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cb0cef79-ce3d-459a-8722-0414fb5717bf already deleted. [ 853.361932] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cb0cef79-ce3d-459a-8722-0414fb5717bf" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.485069] env[65471]: INFO networking_nsxv3.common.synchronization [req-b06b310a-bd05-4217-b168-8adc4ac5fc21 req-38ad9dc5-a687-4c4b-a7fd-da44ce5d552e service nova] Enqueued Resource ID: 8a168c13-528b-4758-b139-f0aa310cde5c with Priority: HIGHEST for action security_group_rules [ 853.485069] env[65471]: INFO networking_nsxv3.common.synchronization [req-b06b310a-bd05-4217-b168-8adc4ac5fc21 req-38ad9dc5-a687-4c4b-a7fd-da44ce5d552e service nova] Enqueued Resource ID: 8a168c13-528b-4758-b139-f0aa310cde5c with Priority: HIGHEST for action security_group_members [ 853.485192] env[65471]: INFO networking_nsxv3.common.synchronization [req-b06b310a-bd05-4217-b168-8adc4ac5fc21 req-38ad9dc5-a687-4c4b-a7fd-da44ce5d552e service nova] Enqueued Resource ID: 2d97e2b3-6d10-4926-8da6-80eceaac5275 with Priority: HIGHEST for action port [ 853.485725] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a168c13-528b-4758-b139-f0aa310cde5c with Priority: HIGHEST for action security_group_rules [ 853.485848] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a168c13-528b-4758-b139-f0aa310cde5c with Priority: HIGHEST for action security_group_members [ 853.485947] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d97e2b3-6d10-4926-8da6-80eceaac5275 with Priority: HIGHEST for action port [ 853.486355] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a168c13-528b-4758-b139-f0aa310cde5c taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.486518] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a168c13-528b-4758-b139-f0aa310cde5c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.486597] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a168c13-528b-4758-b139-f0aa310cde5c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.486828] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a168c13-528b-4758-b139-f0aa310cde5c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.486968] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a168c13-528b-4758-b139-f0aa310cde5c',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.488446] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a168c13-528b-4758-b139-f0aa310cde5c taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.488624] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a168c13-528b-4758-b139-f0aa310cde5c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.488694] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a168c13-528b-4758-b139-f0aa310cde5c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.488997] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a168c13-528b-4758-b139-f0aa310cde5c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.489094] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.489180] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.489235] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.489739] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.489840] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.489925] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a168c13-528b-4758-b139-f0aa310cde5c',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.490895] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-2d97e2b3-6d10-4926-8da6-80eceaac5275 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.491060] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2d97e2b3-6d10-4926-8da6-80eceaac5275" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.491173] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2d97e2b3-6d10-4926-8da6-80eceaac5275" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.491339] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2d97e2b3-6d10-4926-8da6-80eceaac5275" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.491520] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d97e2b3-6d10-4926-8da6-80eceaac5275',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.643817] env[65471]: INFO networking_nsxv3.common.synchronization [req-27521a57-86f4-4733-b567-5b863d735c53 req-6a6fc096-deaf-4220-9ebf-dd08c12d4c67 tempest-ServersV294TestFqdnHostnames-74272933 tempest-ServersV294TestFqdnHostnames-74272933-project-member] Enqueued Resource ID: aa1e565f-d426-4783-ad96-ca42d167f6b8 with Priority: HIGHEST for action security_group_members [ 853.645583] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa1e565f-d426-4783-ad96-ca42d167f6b8 with Priority: HIGHEST for action security_group_members [ 853.645816] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa1e565f-d426-4783-ad96-ca42d167f6b8 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.646024] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa1e565f-d426-4783-ad96-ca42d167f6b8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.646170] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa1e565f-d426-4783-ad96-ca42d167f6b8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.646460] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa1e565f-d426-4783-ad96-ca42d167f6b8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.646935] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.646935] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.646935] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.646935] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.647148] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.647148] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa1e565f-d426-4783-ad96-ca42d167f6b8',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.993963] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a168c13-528b-4758-b139-f0aa310cde5c taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.993963] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a168c13-528b-4758-b139-f0aa310cde5c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.994981] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8a168c13-528b-4758-b139-f0aa310cde5c',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.995538] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2d97e2b3-6d10-4926-8da6-80eceaac5275 with status ACTIVE [ 854.000449] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.000449] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.000603] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.000785] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.000901] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.001813] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.001986] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.002402] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.002402] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.002573] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.004281] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.004281] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.004281] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.004281] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.004281] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.004281] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2d97e2b3-6d10-4926-8da6-80eceaac5275 is going to be updated. [ 854.037385] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.037687] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.037818] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.038491] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.038491] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.038696] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2d97e2b3-6d10-4926-8da6-80eceaac5275" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.071064] env[65471]: INFO networking_nsxv3.common.synchronization [req-6ea8713e-af81-457c-95d3-f9776043dcf9 req-ea468ba9-b9f5-468d-bfe8-4b5f7e517429 tempest-InstanceActionsV221TestJSON-1207349527 tempest-InstanceActionsV221TestJSON-1207349527-project-member] Enqueued Resource ID: ba1a1760-87f6-4927-9e91-698752fe3531 with Priority: HIGHEST for action security_group_members [ 854.071233] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba1a1760-87f6-4927-9e91-698752fe3531 with Priority: HIGHEST for action security_group_members [ 854.071859] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba1a1760-87f6-4927-9e91-698752fe3531 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.072038] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba1a1760-87f6-4927-9e91-698752fe3531" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.072649] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba1a1760-87f6-4927-9e91-698752fe3531" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.072954] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba1a1760-87f6-4927-9e91-698752fe3531" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.073162] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.073274] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.073336] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.073515] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.073597] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.073692] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba1a1760-87f6-4927-9e91-698752fe3531',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.149982] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.150254] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.150375] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.150617] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.188486] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.188486] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.188486] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.188486] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.188486] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.188486] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.188486] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa1e565f-d426-4783-ad96-ca42d167f6b8 is going to be updated. [ 854.230605] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.230855] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.231368] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.231368] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.231518] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.246280] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa1e565f-d426-4783-ad96-ca42d167f6b8 in Status: IN_PROGRESS for 2s [ 854.247169] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58316ca3-525d-4197-969c-1e363b6969c6 in Status: IN_PROGRESS for 4s [ 854.509952] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8a168c13-528b-4758-b139-f0aa310cde5c',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.563809] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock network-621 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.564505] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "network-621" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.564505] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "network-621" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.564505] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "network-621" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.565777] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.565777] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.565777] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.565945] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.566071] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.567244] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 854.567371] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 854.567485] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 854.567594] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 854.567705] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 854.568607] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 854.568820] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 854.576531] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.576677] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.576742] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.576935] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.577033] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.577226] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.577326] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.577384] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.577541] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.577617] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.577709] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba1a1760-87f6-4927-9e91-698752fe3531 already deleted. [ 854.577788] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba1a1760-87f6-4927-9e91-698752fe3531" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.590375] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 854.590541] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 854.590719] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 854.590901] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "network-621" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.591229] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock port-dc5c9f94-1a51-4ffc-ab70-1b0cf63cb2fa taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.591476] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "port-dc5c9f94-1a51-4ffc-ab70-1b0cf63cb2fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.591604] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "port-dc5c9f94-1a51-4ffc-ab70-1b0cf63cb2fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.591985] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "port-dc5c9f94-1a51-4ffc-ab70-1b0cf63cb2fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.592167] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc5c9f94-1a51-4ffc-ab70-1b0cf63cb2fa',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.015598] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.015755] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.015830] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.016349] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.016495] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.016880] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a168c13-528b-4758-b139-f0aa310cde5c is going to be created. [ 855.050449] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.051411] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.051411] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.051411] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.051610] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.065022] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a168c13-528b-4758-b139-f0aa310cde5c in Status: UNINITIALIZED for 2s [ 855.096828] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.097056] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.097400] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.101124] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.101386] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.101608] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Segment Port dc5c9f94-1a51-4ffc-ab70-1b0cf63cb2fa not found, creating... [ 855.101915] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.102104] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.102249] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.102641] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.102836] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.103297] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.103509] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.103632] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.103860] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.103995] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.104151] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Resource: SegmentPort with ID: dc5c9f94-1a51-4ffc-ab70-1b0cf63cb2fa is going to be created. [ 855.130037] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.130292] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.130420] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.130722] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.130977] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.131240] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "port-dc5c9f94-1a51-4ffc-ab70-1b0cf63cb2fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.337654] env[65471]: INFO networking_nsxv3.common.synchronization [None req-cbcf0d42-d48f-4722-ab23-f52cc535ed5e None None] Enqueued Resource ID: 81b2015b-b050-4927-87fc-07e3c9a71832 with Priority: HIGHEST for action port [ 855.338348] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81b2015b-b050-4927-87fc-07e3c9a71832 with Priority: HIGHEST for action port [ 855.338699] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-81b2015b-b050-4927-87fc-07e3c9a71832 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.339052] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-81b2015b-b050-4927-87fc-07e3c9a71832" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.339052] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-81b2015b-b050-4927-87fc-07e3c9a71832" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.339185] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-81b2015b-b050-4927-87fc-07e3c9a71832" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.339247] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81b2015b-b050-4927-87fc-07e3c9a71832',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.841780] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 81b2015b-b050-4927-87fc-07e3c9a71832 [ 855.842180] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.842426] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.842426] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.842615] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.842706] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.842815] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:81b2015b-b050-4927-87fc-07e3c9a71832 already deleted. [ 855.842893] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-81b2015b-b050-4927-87fc-07e3c9a71832" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.957771] env[65471]: INFO networking_nsxv3.common.synchronization [req-6ea8713e-af81-457c-95d3-f9776043dcf9 req-c049cc26-b5c3-4efb-8a0d-965d278ce9f4 service nova] Enqueued Resource ID: ba1a1760-87f6-4927-9e91-698752fe3531 with Priority: HIGHEST for action security_group_rules [ 855.957771] env[65471]: INFO networking_nsxv3.common.synchronization [req-6ea8713e-af81-457c-95d3-f9776043dcf9 req-c049cc26-b5c3-4efb-8a0d-965d278ce9f4 service nova] Enqueued Resource ID: ba1a1760-87f6-4927-9e91-698752fe3531 with Priority: HIGHEST for action security_group_members [ 855.958045] env[65471]: INFO networking_nsxv3.common.synchronization [req-6ea8713e-af81-457c-95d3-f9776043dcf9 req-c049cc26-b5c3-4efb-8a0d-965d278ce9f4 service nova] Enqueued Resource ID: dc5c9f94-1a51-4ffc-ab70-1b0cf63cb2fa with Priority: HIGHEST for action port [ 855.960472] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba1a1760-87f6-4927-9e91-698752fe3531 with Priority: HIGHEST for action security_group_rules [ 855.960697] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba1a1760-87f6-4927-9e91-698752fe3531 with Priority: HIGHEST for action security_group_members [ 855.960929] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc5c9f94-1a51-4ffc-ab70-1b0cf63cb2fa with Priority: HIGHEST for action port [ 855.961241] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ba1a1760-87f6-4927-9e91-698752fe3531 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.961382] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ba1a1760-87f6-4927-9e91-698752fe3531" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.961473] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ba1a1760-87f6-4927-9e91-698752fe3531" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.961793] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ba1a1760-87f6-4927-9e91-698752fe3531" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.961906] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ba1a1760-87f6-4927-9e91-698752fe3531',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.968860] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba1a1760-87f6-4927-9e91-698752fe3531 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.969356] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba1a1760-87f6-4927-9e91-698752fe3531" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.969356] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba1a1760-87f6-4927-9e91-698752fe3531" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.970123] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba1a1760-87f6-4927-9e91-698752fe3531" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.970123] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.970123] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.970123] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.974197] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.974197] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.974197] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba1a1760-87f6-4927-9e91-698752fe3531',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.974197] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-dc5c9f94-1a51-4ffc-ab70-1b0cf63cb2fa taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.974197] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dc5c9f94-1a51-4ffc-ab70-1b0cf63cb2fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.974197] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dc5c9f94-1a51-4ffc-ab70-1b0cf63cb2fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.974197] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dc5c9f94-1a51-4ffc-ab70-1b0cf63cb2fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.974197] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc5c9f94-1a51-4ffc-ab70-1b0cf63cb2fa',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.261831] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa1e565f-d426-4783-ad96-ca42d167f6b8 in Status: SUCCESS [ 856.261831] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa1e565f-d426-4783-ad96-ca42d167f6b8 deletion is rescheduled due to dependency. [ 856.261831] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa1e565f-d426-4783-ad96-ca42d167f6b8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.262853] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58316ca3-525d-4197-969c-1e363b6969c6 in Status: SUCCESS [ 856.263062] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58316ca3-525d-4197-969c-1e363b6969c6 deletion is rescheduled due to dependency. [ 856.263115] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58316ca3-525d-4197-969c-1e363b6969c6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.474630] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ba1a1760-87f6-4927-9e91-698752fe3531',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.477207] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba1a1760-87f6-4927-9e91-698752fe3531 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.477207] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba1a1760-87f6-4927-9e91-698752fe3531" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.477207] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dc5c9f94-1a51-4ffc-ab70-1b0cf63cb2fa with status ACTIVE [ 856.477207] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.477207] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.477207] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.477207] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.477207] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.477688] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.477736] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.478037] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.478252] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.478388] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.478610] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.479118] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.479118] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.479118] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.479118] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.479118] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dc5c9f94-1a51-4ffc-ab70-1b0cf63cb2fa is going to be updated. [ 856.502785] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.502981] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.502981] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.503302] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.503424] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.503637] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dc5c9f94-1a51-4ffc-ab70-1b0cf63cb2fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.642058] env[65471]: INFO networking_nsxv3.common.synchronization [req-ce46eceb-f2ca-4e2f-98d7-0119409fe68c req-5cd67282-84a2-430f-bb3c-cf31d12e3181 tempest-ServerTagsTestJSON-885712363 tempest-ServerTagsTestJSON-885712363-project-member] Enqueued Resource ID: 6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf with Priority: HIGHEST for action security_group_members [ 856.645117] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf with Priority: HIGHEST for action security_group_members [ 856.645117] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.645117] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.645117] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.645117] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.645117] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.645117] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.645117] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.645117] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.645117] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.645117] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.980081] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock network-157 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.980081] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "network-157" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.980081] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "network-157" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.987180] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "network-157" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.987180] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.987180] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.987180] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.987180] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.987180] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.987180] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 856.987180] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 856.987180] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 856.987180] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 856.987180] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 856.987180] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 856.987180] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 856.988395] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ba1a1760-87f6-4927-9e91-698752fe3531',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.006848] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 857.007032] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 857.007173] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 857.007361] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "network-157" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.007756] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock port-9243ebb2-24bd-4c70-8b77-fe020d16578c taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.007882] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "port-9243ebb2-24bd-4c70-8b77-fe020d16578c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.007949] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "port-9243ebb2-24bd-4c70-8b77-fe020d16578c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.008297] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "port-9243ebb2-24bd-4c70-8b77-fe020d16578c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.008476] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9243ebb2-24bd-4c70-8b77-fe020d16578c',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.076781] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a168c13-528b-4758-b139-f0aa310cde5c in Status: SUCCESS [ 857.077051] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a168c13-528b-4758-b139-f0aa310cde5c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.077246] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a168c13-528b-4758-b139-f0aa310cde5c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.077513] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a168c13-528b-4758-b139-f0aa310cde5c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.077692] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.077876] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.077945] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.078196] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.078293] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.078430] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a168c13-528b-4758-b139-f0aa310cde5c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.078522] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8a168c13-528b-4758-b139-f0aa310cde5c',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.146908] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.147162] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.147162] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.147420] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.147510] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.147716] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.147815] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.147875] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.148045] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.148161] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.148199] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf already deleted. [ 857.148279] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.267532] env[65471]: INFO networking_nsxv3.common.synchronization [req-d1560133-6523-4165-98de-ec8f55e96bdc req-b0562448-06a5-4108-87c8-fc7bd0253b59 tempest-AttachInterfacesUnderV243Test-385421637 tempest-AttachInterfacesUnderV243Test-385421637-project-member] Enqueued Resource ID: 927a7ac0-117d-4551-a979-a43f61af6c25 with Priority: HIGHEST for action security_group_members [ 857.268759] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 927a7ac0-117d-4551-a979-a43f61af6c25 with Priority: HIGHEST for action security_group_members [ 857.269291] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-927a7ac0-117d-4551-a979-a43f61af6c25 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.269609] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-927a7ac0-117d-4551-a979-a43f61af6c25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.269704] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-927a7ac0-117d-4551-a979-a43f61af6c25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.269991] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-927a7ac0-117d-4551-a979-a43f61af6c25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.270232] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.270363] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.270443] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.270767] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.270917] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.271076] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('927a7ac0-117d-4551-a979-a43f61af6c25',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.298320] env[65471]: INFO networking_nsxv3.common.synchronization [req-d1560133-6523-4165-98de-ec8f55e96bdc req-b0562448-06a5-4108-87c8-fc7bd0253b59 tempest-AttachInterfacesUnderV243Test-385421637 tempest-AttachInterfacesUnderV243Test-385421637-project-member] Enqueued Resource ID: 927a7ac0-117d-4551-a979-a43f61af6c25 with Priority: HIGHEST for action security_group_rules [ 857.298558] env[65471]: INFO networking_nsxv3.common.synchronization [req-d1560133-6523-4165-98de-ec8f55e96bdc req-b0562448-06a5-4108-87c8-fc7bd0253b59 tempest-AttachInterfacesUnderV243Test-385421637 tempest-AttachInterfacesUnderV243Test-385421637-project-member] Enqueued Resource ID: 927a7ac0-117d-4551-a979-a43f61af6c25 with Priority: HIGHEST for action security_group_members [ 857.298674] env[65471]: INFO networking_nsxv3.common.synchronization [req-d1560133-6523-4165-98de-ec8f55e96bdc req-b0562448-06a5-4108-87c8-fc7bd0253b59 tempest-AttachInterfacesUnderV243Test-385421637 tempest-AttachInterfacesUnderV243Test-385421637-project-member] Enqueued Resource ID: b7f7d722-3ab2-46c4-9816-de31c8439ed6 with Priority: HIGHEST for action port [ 857.299598] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 927a7ac0-117d-4551-a979-a43f61af6c25 with Priority: HIGHEST for action security_group_rules [ 857.299747] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 927a7ac0-117d-4551-a979-a43f61af6c25 with Priority: HIGHEST for action security_group_members [ 857.299747] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7f7d722-3ab2-46c4-9816-de31c8439ed6 with Priority: HIGHEST for action port [ 857.300262] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-927a7ac0-117d-4551-a979-a43f61af6c25 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.300262] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-927a7ac0-117d-4551-a979-a43f61af6c25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.300262] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-927a7ac0-117d-4551-a979-a43f61af6c25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.300572] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-927a7ac0-117d-4551-a979-a43f61af6c25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.300630] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('927a7ac0-117d-4551-a979-a43f61af6c25',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.302649] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-927a7ac0-117d-4551-a979-a43f61af6c25 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.302822] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-927a7ac0-117d-4551-a979-a43f61af6c25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.303091] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-b7f7d722-3ab2-46c4-9816-de31c8439ed6 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.303222] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b7f7d722-3ab2-46c4-9816-de31c8439ed6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.303276] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b7f7d722-3ab2-46c4-9816-de31c8439ed6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.303509] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b7f7d722-3ab2-46c4-9816-de31c8439ed6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.303588] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7f7d722-3ab2-46c4-9816-de31c8439ed6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.493996] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.493996] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.493996] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.493996] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.493996] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.493996] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba1a1760-87f6-4927-9e91-698752fe3531 is going to be created. [ 857.511825] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.511825] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.511825] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.512719] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.512989] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.513269] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Segment Port 9243ebb2-24bd-4c70-8b77-fe020d16578c not found, creating... [ 857.513707] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.514101] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.514359] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.514791] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.518018] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.518018] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.518018] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.518018] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.518018] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.518018] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.518018] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Resource: SegmentPort with ID: 9243ebb2-24bd-4c70-8b77-fe020d16578c is going to be created. [ 857.519313] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.519719] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.519895] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.520183] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.520433] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.534246] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba1a1760-87f6-4927-9e91-698752fe3531 in Status: UNINITIALIZED for 2s [ 857.549369] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.549369] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.549369] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.549369] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.549369] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.549369] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "port-9243ebb2-24bd-4c70-8b77-fe020d16578c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.581455] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8a168c13-528b-4758-b139-f0aa310cde5c',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.774213] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('927a7ac0-117d-4551-a979-a43f61af6c25',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.803348] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-927a7ac0-117d-4551-a979-a43f61af6c25 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.803348] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-927a7ac0-117d-4551-a979-a43f61af6c25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.806194] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b7f7d722-3ab2-46c4-9816-de31c8439ed6 with status ACTIVE [ 857.806421] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.806553] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.806620] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.806867] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.806961] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.807168] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.807271] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.807334] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.807490] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.807565] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.807758] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.807850] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.807897] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.808044] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.808119] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.808205] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b7f7d722-3ab2-46c4-9816-de31c8439ed6 is going to be updated. [ 857.832647] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.832808] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.832980] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.833227] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.833369] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.833533] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b7f7d722-3ab2-46c4-9816-de31c8439ed6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.084864] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8a168c13-528b-4758-b139-f0aa310cde5c: rpc.has_security_group_logging(os_id): False [ 858.110605] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.110605] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.110605] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.110902] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.111021] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.111386] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.111553] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.111604] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.111817] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.111906] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.111998] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a168c13-528b-4758-b139-f0aa310cde5c is going to be created. [ 858.173538] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.173750] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.173833] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.174093] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.174295] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.187340] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a168c13-528b-4758-b139-f0aa310cde5c in Status: IN_PROGRESS for 2s [ 858.276201] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('927a7ac0-117d-4551-a979-a43f61af6c25',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.344586] env[65471]: INFO networking_nsxv3.common.synchronization [req-ce46eceb-f2ca-4e2f-98d7-0119409fe68c req-b10ee32f-8654-4edb-adba-94b6d5be258d service nova] Enqueued Resource ID: 6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf with Priority: HIGHEST for action security_group_rules [ 858.344781] env[65471]: INFO networking_nsxv3.common.synchronization [req-ce46eceb-f2ca-4e2f-98d7-0119409fe68c req-b10ee32f-8654-4edb-adba-94b6d5be258d service nova] Enqueued Resource ID: 6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf with Priority: HIGHEST for action security_group_members [ 858.344918] env[65471]: INFO networking_nsxv3.common.synchronization [req-ce46eceb-f2ca-4e2f-98d7-0119409fe68c req-b10ee32f-8654-4edb-adba-94b6d5be258d service nova] Enqueued Resource ID: 9243ebb2-24bd-4c70-8b77-fe020d16578c with Priority: HIGHEST for action port [ 858.346186] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf with Priority: HIGHEST for action security_group_rules [ 858.346186] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf with Priority: HIGHEST for action security_group_members [ 858.346186] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9243ebb2-24bd-4c70-8b77-fe020d16578c with Priority: HIGHEST for action port [ 858.346418] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.346533] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.346613] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.346849] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.346931] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.347918] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.348065] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.348168] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.348310] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.350446] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.352292] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.352462] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.352666] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.352757] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.352859] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.356734] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-9243ebb2-24bd-4c70-8b77-fe020d16578c taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.357240] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9243ebb2-24bd-4c70-8b77-fe020d16578c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.357240] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9243ebb2-24bd-4c70-8b77-fe020d16578c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.357770] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9243ebb2-24bd-4c70-8b77-fe020d16578c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.357866] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9243ebb2-24bd-4c70-8b77-fe020d16578c',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.783186] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.783186] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.783186] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.783186] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.783186] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.783186] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 927a7ac0-117d-4551-a979-a43f61af6c25 is going to be updated. [ 858.794898] env[65471]: INFO networking_nsxv3.common.synchronization [req-f962a234-44f2-46fd-b145-c950083d1d01 req-b75515e6-51ce-4ac7-9e2c-62c28e6192c3 tempest-ServerGroupTestJSON-2115080229 tempest-ServerGroupTestJSON-2115080229-project-member] Enqueued Resource ID: 44a00269-8b59-46f1-9a1e-09081fed9489 with Priority: HIGHEST for action security_group_members [ 858.795715] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44a00269-8b59-46f1-9a1e-09081fed9489 with Priority: HIGHEST for action security_group_members [ 858.796140] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-44a00269-8b59-46f1-9a1e-09081fed9489 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.796747] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44a00269-8b59-46f1-9a1e-09081fed9489" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.796826] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44a00269-8b59-46f1-9a1e-09081fed9489" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.797089] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44a00269-8b59-46f1-9a1e-09081fed9489" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.797285] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.797418] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.797514] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.797703] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.797814] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.797896] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44a00269-8b59-46f1-9a1e-09081fed9489',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.815166] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.815339] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.815532] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.815685] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.815878] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.828150] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 927a7ac0-117d-4551-a979-a43f61af6c25 in Status: IN_PROGRESS for 2s [ 858.857793] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.862517] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9243ebb2-24bd-4c70-8b77-fe020d16578c with status ACTIVE [ 858.862517] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.862517] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.862517] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.862517] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.862517] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.862517] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.862920] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.862920] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.862920] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.862920] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.863117] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.863208] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.863266] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.863417] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.863487] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.863572] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9243ebb2-24bd-4c70-8b77-fe020d16578c is going to be updated. [ 858.865217] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.865217] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.887393] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.887557] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.889421] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.889421] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.889421] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.889421] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9243ebb2-24bd-4c70-8b77-fe020d16578c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.300576] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.300876] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.300876] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.301031] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.301126] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.301380] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.301548] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.301612] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.301784] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.301851] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.301941] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44a00269-8b59-46f1-9a1e-09081fed9489 is going to be updated. [ 859.339759] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.339997] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.339997] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.340124] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.340254] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.351554] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44a00269-8b59-46f1-9a1e-09081fed9489 in Status: IN_PROGRESS for 2s [ 859.361178] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.545355] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba1a1760-87f6-4927-9e91-698752fe3531 in Status: SUCCESS [ 859.545355] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba1a1760-87f6-4927-9e91-698752fe3531" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.545355] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba1a1760-87f6-4927-9e91-698752fe3531" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.545355] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba1a1760-87f6-4927-9e91-698752fe3531" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.545355] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.545355] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.545355] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.545355] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.545355] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.545856] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba1a1760-87f6-4927-9e91-698752fe3531" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.545856] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ba1a1760-87f6-4927-9e91-698752fe3531',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.864627] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.864743] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.864743] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.865084] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.865214] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.865394] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf is going to be created. [ 859.892767] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.892767] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.892767] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.893017] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.893169] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.906448] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf in Status: UNINITIALIZED for 2s [ 860.049230] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba1a1760-87f6-4927-9e91-698752fe3531 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.049664] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba1a1760-87f6-4927-9e91-698752fe3531" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.049664] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba1a1760-87f6-4927-9e91-698752fe3531" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.050989] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba1a1760-87f6-4927-9e91-698752fe3531" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.050989] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.051318] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.051318] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.051540] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.051540] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.051772] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba1a1760-87f6-4927-9e91-698752fe3531" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.051943] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba1a1760-87f6-4927-9e91-698752fe3531 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.052099] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba1a1760-87f6-4927-9e91-698752fe3531" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.052215] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba1a1760-87f6-4927-9e91-698752fe3531" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.052507] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba1a1760-87f6-4927-9e91-698752fe3531" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.052507] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.052602] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.052637] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.053324] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.053324] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.053324] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba1a1760-87f6-4927-9e91-698752fe3531" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.053324] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ba1a1760-87f6-4927-9e91-698752fe3531',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.203905] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a168c13-528b-4758-b139-f0aa310cde5c in Status: SUCCESS [ 860.204339] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a168c13-528b-4758-b139-f0aa310cde5c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.556835] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ba1a1760-87f6-4927-9e91-698752fe3531: rpc.has_security_group_logging(os_id): False [ 860.575266] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.575421] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.575558] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.575715] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.575809] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.576049] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.576150] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.576212] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.576367] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.576444] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.576638] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.576712] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.576773] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.576922] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.576996] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.577208] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.577296] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.577361] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.577745] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.577831] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.577921] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ba1a1760-87f6-4927-9e91-698752fe3531 is going to be created. [ 860.665247] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.665432] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.665549] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.665685] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.665868] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.678614] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ba1a1760-87f6-4927-9e91-698752fe3531 in Status: IN_PROGRESS for 2s [ 860.838805] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 927a7ac0-117d-4551-a979-a43f61af6c25 in Status: SUCCESS [ 860.838805] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-927a7ac0-117d-4551-a979-a43f61af6c25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.838805] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-927a7ac0-117d-4551-a979-a43f61af6c25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.839191] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-927a7ac0-117d-4551-a979-a43f61af6c25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.839230] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.839341] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.839410] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.839562] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.839643] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.839738] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('927a7ac0-117d-4551-a979-a43f61af6c25',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.341955] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('927a7ac0-117d-4551-a979-a43f61af6c25',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.364940] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44a00269-8b59-46f1-9a1e-09081fed9489 in Status: SUCCESS [ 861.365224] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44a00269-8b59-46f1-9a1e-09081fed9489 deletion is rescheduled due to dependency. [ 861.365398] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44a00269-8b59-46f1-9a1e-09081fed9489" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.739112] env[65471]: INFO networking_nsxv3.common.synchronization [req-c4f13c7f-4aab-4341-b7fe-74bf3928e864 req-39736994-89b5-44d6-b5e7-855b330a6db1 tempest-AttachInterfacesUnderV243Test-385421637 tempest-AttachInterfacesUnderV243Test-385421637-project-member] Enqueued Resource ID: 927a7ac0-117d-4551-a979-a43f61af6c25 with Priority: HIGHEST for action security_group_members [ 861.740458] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 927a7ac0-117d-4551-a979-a43f61af6c25 with Priority: HIGHEST for action security_group_members [ 861.740458] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-927a7ac0-117d-4551-a979-a43f61af6c25 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.741186] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-927a7ac0-117d-4551-a979-a43f61af6c25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.759232] env[65471]: INFO networking_nsxv3.common.synchronization [req-c4f13c7f-4aab-4341-b7fe-74bf3928e864 req-39736994-89b5-44d6-b5e7-855b330a6db1 tempest-AttachInterfacesUnderV243Test-385421637 tempest-AttachInterfacesUnderV243Test-385421637-project-member] Enqueued Resource ID: 927a7ac0-117d-4551-a979-a43f61af6c25 with Priority: HIGHEST for action security_group_rules [ 861.759232] env[65471]: INFO networking_nsxv3.common.synchronization [req-c4f13c7f-4aab-4341-b7fe-74bf3928e864 req-39736994-89b5-44d6-b5e7-855b330a6db1 tempest-AttachInterfacesUnderV243Test-385421637 tempest-AttachInterfacesUnderV243Test-385421637-project-member] Enqueued Resource ID: 927a7ac0-117d-4551-a979-a43f61af6c25 with Priority: HIGHEST for action security_group_members [ 861.759232] env[65471]: INFO networking_nsxv3.common.synchronization [req-c4f13c7f-4aab-4341-b7fe-74bf3928e864 req-39736994-89b5-44d6-b5e7-855b330a6db1 tempest-AttachInterfacesUnderV243Test-385421637 tempest-AttachInterfacesUnderV243Test-385421637-project-member] Enqueued Resource ID: b7f7d722-3ab2-46c4-9816-de31c8439ed6 with Priority: HIGHEST for action port [ 861.759924] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 927a7ac0-117d-4551-a979-a43f61af6c25 with Priority: HIGHEST for action security_group_rules [ 861.760069] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 927a7ac0-117d-4551-a979-a43f61af6c25 with Priority: HIGHEST for action security_group_members [ 861.761050] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7f7d722-3ab2-46c4-9816-de31c8439ed6 with Priority: HIGHEST for action port [ 861.761050] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-927a7ac0-117d-4551-a979-a43f61af6c25 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.761050] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-927a7ac0-117d-4551-a979-a43f61af6c25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.761050] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-927a7ac0-117d-4551-a979-a43f61af6c25 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.761050] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-927a7ac0-117d-4551-a979-a43f61af6c25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.762800] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-b7f7d722-3ab2-46c4-9816-de31c8439ed6 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.762932] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b7f7d722-3ab2-46c4-9816-de31c8439ed6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.763011] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b7f7d722-3ab2-46c4-9816-de31c8439ed6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.763239] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b7f7d722-3ab2-46c4-9816-de31c8439ed6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.763314] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7f7d722-3ab2-46c4-9816-de31c8439ed6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.844218] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('927a7ac0-117d-4551-a979-a43f61af6c25',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.917946] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf in Status: SUCCESS [ 861.918187] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.918422] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.918795] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.919097] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.919490] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.919490] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.919593] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.919593] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.919838] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.920564] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.076618] env[65471]: INFO networking_nsxv3.common.synchronization [req-f8eee9f1-3081-42b7-8419-c31a766a019f req-ad598f91-fa2c-41e8-9c8c-3b5b3406ffc2 tempest-ImagesOneServerNegativeTestJSON-124059679 tempest-ImagesOneServerNegativeTestJSON-124059679-project-member] Enqueued Resource ID: a3c5f688-9271-4722-84e9-69667c674933 with Priority: HIGHEST for action security_group_members [ 862.077251] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3c5f688-9271-4722-84e9-69667c674933 with Priority: HIGHEST for action security_group_members [ 862.077603] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3c5f688-9271-4722-84e9-69667c674933 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.077744] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.077905] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.078307] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.078564] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.078746] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.078933] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.079212] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.079340] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.079492] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a3c5f688-9271-4722-84e9-69667c674933',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.176725] env[65471]: INFO networking_nsxv3.common.synchronization [req-11c8516f-b042-4137-a965-cac7c68edfbd req-07e314de-82c7-423e-a720-7335a0445096 tempest-AttachInterfacesTestJSON-1197806586 tempest-AttachInterfacesTestJSON-1197806586-project-member] Enqueued Resource ID: e8869e0a-9385-48b2-ac90-589c8415df21 with Priority: HIGHEST for action security_group_members [ 862.178026] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8869e0a-9385-48b2-ac90-589c8415df21 with Priority: HIGHEST for action security_group_members [ 862.178026] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8869e0a-9385-48b2-ac90-589c8415df21 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.178026] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.178026] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.178468] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.178687] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.178855] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.179016] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.179250] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.179409] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.179629] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e8869e0a-9385-48b2-ac90-589c8415df21',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.268838] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b7f7d722-3ab2-46c4-9816-de31c8439ed6 with status ACTIVE [ 862.269146] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.269286] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.269353] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.269595] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.269686] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.269890] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.270089] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.270223] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.270464] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.270556] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.270768] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.270863] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.270927] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.271092] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.271165] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.271357] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b7f7d722-3ab2-46c4-9816-de31c8439ed6 is going to be updated. [ 862.327563] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.327911] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.328090] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.328518] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.328518] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.328958] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b7f7d722-3ab2-46c4-9816-de31c8439ed6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.348984] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.349483] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.349609] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.350017] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.350274] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.350524] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 927a7ac0-117d-4551-a979-a43f61af6c25 is going to be updated. [ 862.422804] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.423186] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.423879] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.424119] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.424520] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.424520] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.424697] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.424742] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.424817] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.425015] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.425061] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.425159] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.425273] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.425370] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.425514] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.425622] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.425685] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.425826] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.425904] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.425988] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.427775] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.429715] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.429845] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.429893] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.430076] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.430219] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.447999] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 927a7ac0-117d-4551-a979-a43f61af6c25 in Status: IN_PROGRESS for 2s [ 862.583645] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.583899] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.583899] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.584149] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.584266] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.584557] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.584717] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.585086] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.585086] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.585086] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.585239] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3c5f688-9271-4722-84e9-69667c674933 is going to be updated. [ 862.634997] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.634997] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.634997] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.634997] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.634997] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.650781] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3c5f688-9271-4722-84e9-69667c674933 in Status: IN_PROGRESS for 2s [ 862.682454] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.682641] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.682682] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.682872] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.683015] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.683198] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.683282] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.683319] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.683482] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.683557] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.683643] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8869e0a-9385-48b2-ac90-589c8415df21 already deleted. [ 862.683746] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.699118] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ba1a1760-87f6-4927-9e91-698752fe3531 in Status: SUCCESS [ 862.699118] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ba1a1760-87f6-4927-9e91-698752fe3531" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.934384] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf: rpc.has_security_group_logging(os_id): False [ 862.955261] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.955407] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.955484] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.955706] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.955794] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.956027] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.956113] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.956176] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.956344] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.956423] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.956600] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.956684] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.956749] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.956884] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.956957] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.957154] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.957247] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.957306] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.957440] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.957514] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.957597] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf is going to be created. [ 863.043972] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock network-238 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.044272] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "network-238" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.044381] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "network-238" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.044744] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "network-238" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.045126] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.045428] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.045495] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.045706] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.045911] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.046084] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 863.046241] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 863.046308] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 863.046398] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 863.046547] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 863.046633] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 863.046779] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 863.049077] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.049213] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.049390] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.049435] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.049609] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.067910] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf in Status: IN_PROGRESS for 2s [ 863.071281] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 863.071595] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 863.071786] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 863.071962] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "network-238" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.072363] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock port-028a1d62-d91b-41ff-a23f-d362abbccfb4 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.072646] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "port-028a1d62-d91b-41ff-a23f-d362abbccfb4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.072866] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "port-028a1d62-d91b-41ff-a23f-d362abbccfb4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.073303] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "port-028a1d62-d91b-41ff-a23f-d362abbccfb4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.073562] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('028a1d62-d91b-41ff-a23f-d362abbccfb4',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.116027] env[65471]: INFO networking_nsxv3.common.synchronization [req-5c0bcd9d-0b53-4ba0-91d7-8232a4f8e5c5 req-74516fcf-9f9a-4205-a25b-7f1966962578 tempest-ServersAdminTestJSON-1197360877 tempest-ServersAdminTestJSON-1197360877-project-member] Enqueued Resource ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 with Priority: HIGHEST for action security_group_members [ 863.116027] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 with Priority: HIGHEST for action security_group_members [ 863.116027] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4ca8456-5b21-4080-b762-7b52a4837eb1 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.116027] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.116027] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.116027] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.116534] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.116534] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.116534] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.116695] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.116757] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.116852] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4ca8456-5b21-4080-b762-7b52a4837eb1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.576465] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.576690] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.576825] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.577115] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.577264] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.577414] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Segment Port 028a1d62-d91b-41ff-a23f-d362abbccfb4 not found, creating... [ 863.577816] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.578009] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.578088] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.578309] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.578444] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.578734] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.578905] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.578987] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.579253] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.579387] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.579523] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Resource: SegmentPort with ID: 028a1d62-d91b-41ff-a23f-d362abbccfb4 is going to be created. [ 863.602797] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.602952] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.602952] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.603257] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.603491] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.603795] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "port-028a1d62-d91b-41ff-a23f-d362abbccfb4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.621208] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e4ca8456-5b21-4080-b762-7b52a4837eb1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.126360] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e4ca8456-5b21-4080-b762-7b52a4837eb1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.396953] env[65471]: INFO networking_nsxv3.common.synchronization [req-11c8516f-b042-4137-a965-cac7c68edfbd req-fa46bd58-9764-4335-acc4-335816b03dd4 service nova] Enqueued Resource ID: e8869e0a-9385-48b2-ac90-589c8415df21 with Priority: HIGHEST for action security_group_rules [ 864.397270] env[65471]: INFO networking_nsxv3.common.synchronization [req-11c8516f-b042-4137-a965-cac7c68edfbd req-fa46bd58-9764-4335-acc4-335816b03dd4 service nova] Enqueued Resource ID: e8869e0a-9385-48b2-ac90-589c8415df21 with Priority: HIGHEST for action security_group_members [ 864.397486] env[65471]: INFO networking_nsxv3.common.synchronization [req-11c8516f-b042-4137-a965-cac7c68edfbd req-fa46bd58-9764-4335-acc4-335816b03dd4 service nova] Enqueued Resource ID: 028a1d62-d91b-41ff-a23f-d362abbccfb4 with Priority: HIGHEST for action port [ 864.400626] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8869e0a-9385-48b2-ac90-589c8415df21 with Priority: HIGHEST for action security_group_rules [ 864.400626] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8869e0a-9385-48b2-ac90-589c8415df21 with Priority: HIGHEST for action security_group_members [ 864.400626] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 028a1d62-d91b-41ff-a23f-d362abbccfb4 with Priority: HIGHEST for action port [ 864.400626] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e8869e0a-9385-48b2-ac90-589c8415df21 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.400626] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.400626] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.400626] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.400626] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e8869e0a-9385-48b2-ac90-589c8415df21',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.405077] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8869e0a-9385-48b2-ac90-589c8415df21 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.405077] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.405077] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.405077] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.405077] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.405077] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.405077] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.405077] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.405077] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.405077] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e8869e0a-9385-48b2-ac90-589c8415df21',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.405077] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-028a1d62-d91b-41ff-a23f-d362abbccfb4 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.405077] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-028a1d62-d91b-41ff-a23f-d362abbccfb4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.405077] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-028a1d62-d91b-41ff-a23f-d362abbccfb4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.405077] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-028a1d62-d91b-41ff-a23f-d362abbccfb4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.405077] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('028a1d62-d91b-41ff-a23f-d362abbccfb4',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.459213] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 927a7ac0-117d-4551-a979-a43f61af6c25 in Status: SUCCESS [ 864.459633] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-927a7ac0-117d-4551-a979-a43f61af6c25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.459765] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-927a7ac0-117d-4551-a979-a43f61af6c25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.459995] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-927a7ac0-117d-4551-a979-a43f61af6c25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.460232] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.460366] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.460430] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.460649] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.461614] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.461614] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-927a7ac0-117d-4551-a979-a43f61af6c25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.461614] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('927a7ac0-117d-4551-a979-a43f61af6c25',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.461853] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-927a7ac0-117d-4551-a979-a43f61af6c25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.462255] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-927a7ac0-117d-4551-a979-a43f61af6c25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.462255] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.462255] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.462487] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.462487] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.463019] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.463019] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('927a7ac0-117d-4551-a979-a43f61af6c25',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.629065] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.629360] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.629481] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.629801] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.629942] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.630117] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 is going to be updated. [ 864.661919] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3c5f688-9271-4722-84e9-69667c674933 in Status: SUCCESS [ 864.662179] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3c5f688-9271-4722-84e9-69667c674933 deletion is rescheduled due to dependency. [ 864.662382] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.665907] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.666042] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.666042] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.666511] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.666511] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.675829] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 in Status: IN_PROGRESS for 2s [ 864.906753] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8869e0a-9385-48b2-ac90-589c8415df21 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.907104] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.907300] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e8869e0a-9385-48b2-ac90-589c8415df21',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.908683] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 028a1d62-d91b-41ff-a23f-d362abbccfb4 with status ACTIVE [ 864.908761] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.908836] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.908898] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.909320] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.909413] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.909596] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.909703] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.909805] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.910531] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.910531] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.910531] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.910531] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.910531] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.910531] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.910531] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.910935] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 028a1d62-d91b-41ff-a23f-d362abbccfb4 is going to be updated. [ 864.942529] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.942723] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.942723] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.942933] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.943074] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.943237] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-028a1d62-d91b-41ff-a23f-d362abbccfb4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.964555] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('927a7ac0-117d-4551-a979-a43f61af6c25',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.966821] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('927a7ac0-117d-4551-a979-a43f61af6c25',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.083033] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf in Status: SUCCESS [ 865.083033] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.412926] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e8869e0a-9385-48b2-ac90-589c8415df21',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.467351] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 927a7ac0-117d-4551-a979-a43f61af6c25: rpc.has_security_group_logging(os_id): False [ 865.468782] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('927a7ac0-117d-4551-a979-a43f61af6c25',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.494769] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.494952] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.495014] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.495244] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.528310] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.528310] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.528644] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.528689] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.529018] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.529234] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.529459] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 927a7ac0-117d-4551-a979-a43f61af6c25 is going to be updated. [ 865.614742] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.614916] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.614968] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.615190] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.616086] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.632228] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 927a7ac0-117d-4551-a979-a43f61af6c25 in Status: IN_PROGRESS for 2s [ 865.916014] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.916202] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.916271] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.916493] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.916585] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.916693] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8869e0a-9385-48b2-ac90-589c8415df21 is going to be created. [ 865.945590] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.945806] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.945806] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.946708] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.947049] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.957796] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8869e0a-9385-48b2-ac90-589c8415df21 in Status: UNINITIALIZED for 2s [ 865.971539] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.971694] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.971765] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.971971] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.972064] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.972166] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 927a7ac0-117d-4551-a979-a43f61af6c25 is going to be updated. [ 866.011043] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.011201] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.011272] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.011658] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.011820] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.023472] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 927a7ac0-117d-4551-a979-a43f61af6c25 in Status: IN_PROGRESS for 2s [ 866.687809] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 in Status: SUCCESS [ 866.688204] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.647449] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 927a7ac0-117d-4551-a979-a43f61af6c25 in Status: SUCCESS [ 867.647545] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-927a7ac0-117d-4551-a979-a43f61af6c25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.647682] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-927a7ac0-117d-4551-a979-a43f61af6c25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.647911] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-927a7ac0-117d-4551-a979-a43f61af6c25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.648016] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('927a7ac0-117d-4551-a979-a43f61af6c25',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.912771] env[65471]: INFO networking_nsxv3.common.synchronization [req-cbc564fc-a652-478e-9dec-a5fc8463155d req-6bb5ac21-e4bc-4ccb-9b46-0f3e57bb2305 tempest-ServerActionsTestOtherA-1623203122 tempest-ServerActionsTestOtherA-1623203122-project-member] Enqueued Resource ID: e7122ab9-4313-4173-8869-cf7cd16cccf0 with Priority: HIGHEST for action security_group_members [ 867.914932] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7122ab9-4313-4173-8869-cf7cd16cccf0 with Priority: HIGHEST for action security_group_members [ 867.915435] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7122ab9-4313-4173-8869-cf7cd16cccf0 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.915698] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7122ab9-4313-4173-8869-cf7cd16cccf0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.915698] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7122ab9-4313-4173-8869-cf7cd16cccf0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.917028] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7122ab9-4313-4173-8869-cf7cd16cccf0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.917028] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.918751] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.918828] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.919012] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.919142] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.919251] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7122ab9-4313-4173-8869-cf7cd16cccf0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.970019] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8869e0a-9385-48b2-ac90-589c8415df21 in Status: SUCCESS [ 867.970019] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.970019] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.970019] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.970019] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.970019] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.970019] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.970019] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.970019] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.970019] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.970019] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e8869e0a-9385-48b2-ac90-589c8415df21',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.036013] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 927a7ac0-117d-4551-a979-a43f61af6c25 in Status: SUCCESS [ 868.036165] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-927a7ac0-117d-4551-a979-a43f61af6c25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.036384] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-927a7ac0-117d-4551-a979-a43f61af6c25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.037389] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-927a7ac0-117d-4551-a979-a43f61af6c25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.037389] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.037389] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.037389] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.037389] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.037651] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.037859] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('927a7ac0-117d-4551-a979-a43f61af6c25',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.150511] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-927a7ac0-117d-4551-a979-a43f61af6c25 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.150740] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-927a7ac0-117d-4551-a979-a43f61af6c25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.165116] env[65471]: INFO networking_nsxv3.common.synchronization [req-fa5aa5d7-fe8f-46d9-ba36-7d9c54480d33 req-9d9a4eb7-20eb-47e1-b98b-d85e0ed86243 tempest-AttachInterfacesUnderV243Test-385421637 tempest-AttachInterfacesUnderV243Test-385421637-project-member] Enqueued Resource ID: 927a7ac0-117d-4551-a979-a43f61af6c25 with Priority: HIGHEST for action security_group_members [ 868.165796] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 927a7ac0-117d-4551-a979-a43f61af6c25 with Priority: HIGHEST for action security_group_members [ 868.166208] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-927a7ac0-117d-4551-a979-a43f61af6c25 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.166357] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-927a7ac0-117d-4551-a979-a43f61af6c25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.304790] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock network-344 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.304983] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "network-344" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.305120] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "network-344" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.305389] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "network-344" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.305652] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.305808] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.305938] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.306227] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.306378] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.306599] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 868.306703] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 868.306803] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 868.306909] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 868.307022] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 868.307129] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 868.307255] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 868.331207] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 868.332249] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 868.332521] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 868.332800] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "network-344" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.333262] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock port-bc6066aa-31e8-42a3-a6de-6a92855d9854 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.333445] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "port-bc6066aa-31e8-42a3-a6de-6a92855d9854" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.333841] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "port-bc6066aa-31e8-42a3-a6de-6a92855d9854" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.333989] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "port-bc6066aa-31e8-42a3-a6de-6a92855d9854" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.334157] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc6066aa-31e8-42a3-a6de-6a92855d9854',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.424508] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.424508] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.424508] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.424508] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.424508] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.424508] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.424508] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.424508] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.424508] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.424508] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.424508] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7122ab9-4313-4173-8869-cf7cd16cccf0 already deleted. [ 868.424508] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7122ab9-4313-4173-8869-cf7cd16cccf0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.475212] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8869e0a-9385-48b2-ac90-589c8415df21 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.475212] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.475212] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.475212] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.475212] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.475212] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.475212] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.475212] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.475212] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.475212] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.475212] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8869e0a-9385-48b2-ac90-589c8415df21 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.475212] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.475212] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.475212] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.475212] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.475212] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.476872] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.476872] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.476872] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.476872] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.476872] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e8869e0a-9385-48b2-ac90-589c8415df21',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.540297] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('927a7ac0-117d-4551-a979-a43f61af6c25',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.836687] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.836963] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.837067] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.837351] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.837502] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.837656] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Segment Port bc6066aa-31e8-42a3-a6de-6a92855d9854 not found, creating... [ 868.837920] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.838085] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.838202] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.838418] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.838564] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.838840] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.838987] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.839139] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.839564] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.839564] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.839657] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Resource: SegmentPort with ID: bc6066aa-31e8-42a3-a6de-6a92855d9854 is going to be created. [ 868.863637] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.863933] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.863991] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.864308] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.864550] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.864803] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "port-bc6066aa-31e8-42a3-a6de-6a92855d9854" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.977363] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e8869e0a-9385-48b2-ac90-589c8415df21: rpc.has_security_group_logging(os_id): False [ 869.017094] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.017281] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.017344] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.017563] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.017664] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.017874] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.017970] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.018049] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.018322] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.018322] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.018498] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.018602] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.018653] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.018787] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.018882] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.019082] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.019831] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.019831] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.019831] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.019831] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.019831] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e8869e0a-9385-48b2-ac90-589c8415df21 is going to be created. [ 869.043551] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('927a7ac0-117d-4551-a979-a43f61af6c25',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.215923] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.216112] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.216288] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.216674] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.216905] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.245773] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e8869e0a-9385-48b2-ac90-589c8415df21 in Status: IN_PROGRESS for 2s [ 869.546060] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.546202] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.547071] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.547071] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.547071] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.547071] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 927a7ac0-117d-4551-a979-a43f61af6c25 is going to be updated. [ 869.584439] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.584590] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.584642] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.584905] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.585072] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.595373] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 927a7ac0-117d-4551-a979-a43f61af6c25 in Status: IN_PROGRESS for 2s [ 869.612777] env[65471]: INFO networking_nsxv3.common.synchronization [req-cbc564fc-a652-478e-9dec-a5fc8463155d req-4df7a7bd-856a-4181-a597-3ad7d5c77a4e service nova] Enqueued Resource ID: e7122ab9-4313-4173-8869-cf7cd16cccf0 with Priority: HIGHEST for action security_group_rules [ 869.612947] env[65471]: INFO networking_nsxv3.common.synchronization [req-cbc564fc-a652-478e-9dec-a5fc8463155d req-4df7a7bd-856a-4181-a597-3ad7d5c77a4e service nova] Enqueued Resource ID: e7122ab9-4313-4173-8869-cf7cd16cccf0 with Priority: HIGHEST for action security_group_members [ 869.613092] env[65471]: INFO networking_nsxv3.common.synchronization [req-cbc564fc-a652-478e-9dec-a5fc8463155d req-4df7a7bd-856a-4181-a597-3ad7d5c77a4e service nova] Enqueued Resource ID: bc6066aa-31e8-42a3-a6de-6a92855d9854 with Priority: HIGHEST for action port [ 869.613625] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7122ab9-4313-4173-8869-cf7cd16cccf0 with Priority: HIGHEST for action security_group_rules [ 869.615251] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7122ab9-4313-4173-8869-cf7cd16cccf0 with Priority: HIGHEST for action security_group_members [ 869.615339] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc6066aa-31e8-42a3-a6de-6a92855d9854 with Priority: HIGHEST for action port [ 869.616696] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e7122ab9-4313-4173-8869-cf7cd16cccf0 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.617281] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e7122ab9-4313-4173-8869-cf7cd16cccf0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.617367] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e7122ab9-4313-4173-8869-cf7cd16cccf0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.617663] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e7122ab9-4313-4173-8869-cf7cd16cccf0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.617793] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e7122ab9-4313-4173-8869-cf7cd16cccf0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.618898] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7122ab9-4313-4173-8869-cf7cd16cccf0 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.618898] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7122ab9-4313-4173-8869-cf7cd16cccf0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.618898] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7122ab9-4313-4173-8869-cf7cd16cccf0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.619985] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7122ab9-4313-4173-8869-cf7cd16cccf0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.620184] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.620277] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.620354] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.620500] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.620587] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.620681] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7122ab9-4313-4173-8869-cf7cd16cccf0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.621637] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-bc6066aa-31e8-42a3-a6de-6a92855d9854 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.621743] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bc6066aa-31e8-42a3-a6de-6a92855d9854" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.621973] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bc6066aa-31e8-42a3-a6de-6a92855d9854" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.621973] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bc6066aa-31e8-42a3-a6de-6a92855d9854" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.622083] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc6066aa-31e8-42a3-a6de-6a92855d9854',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.123857] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7122ab9-4313-4173-8869-cf7cd16cccf0 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.127186] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7122ab9-4313-4173-8869-cf7cd16cccf0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.127186] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e7122ab9-4313-4173-8869-cf7cd16cccf0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.127186] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bc6066aa-31e8-42a3-a6de-6a92855d9854 with status ACTIVE [ 870.127186] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.127186] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.127186] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.127491] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.127617] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.127783] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.127886] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.127966] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.128505] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.128723] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.130221] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.130360] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.130426] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.130588] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.130668] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.130746] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bc6066aa-31e8-42a3-a6de-6a92855d9854 is going to be updated. [ 870.154073] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.154277] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.154336] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.154627] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.154715] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.155497] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bc6066aa-31e8-42a3-a6de-6a92855d9854" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.398169] env[65471]: INFO networking_nsxv3.common.synchronization [req-460c71d7-e123-4c52-a838-642696320e13 req-73bac06f-0f38-4358-a48e-0d46771d97e4 tempest-InstanceActionsV221TestJSON-1207349527 tempest-InstanceActionsV221TestJSON-1207349527-project-member] Enqueued Resource ID: ba1a1760-87f6-4927-9e91-698752fe3531 with Priority: HIGHEST for action security_group_members [ 870.398766] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba1a1760-87f6-4927-9e91-698752fe3531 with Priority: HIGHEST for action security_group_members [ 870.399102] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba1a1760-87f6-4927-9e91-698752fe3531 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.399230] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba1a1760-87f6-4927-9e91-698752fe3531" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.399313] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba1a1760-87f6-4927-9e91-698752fe3531" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.399767] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba1a1760-87f6-4927-9e91-698752fe3531" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.399970] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.400104] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.400170] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.400345] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.400436] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.400541] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba1a1760-87f6-4927-9e91-698752fe3531',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.633053] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e7122ab9-4313-4173-8869-cf7cd16cccf0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.904312] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.904312] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.904312] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.904312] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.904312] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.904697] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.904697] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.904697] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.904697] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.905130] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.905130] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba1a1760-87f6-4927-9e91-698752fe3531 is going to be updated. [ 870.934015] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.935584] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.935584] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.935584] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.935584] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.943704] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba1a1760-87f6-4927-9e91-698752fe3531 in Status: IN_PROGRESS for 2s [ 871.017195] env[65471]: INFO networking_nsxv3.common.synchronization [None req-c92d724a-afb1-4e14-a0bc-eba8f85ed002 tempest-ServerActionsTestJSON-1061383532 tempest-ServerActionsTestJSON-1061383532-project-member] Enqueued Resource ID: 847d876e-b40b-4d73-9c81-1622676c73b5 with Priority: HIGHEST for action security_group_rules [ 871.017740] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 847d876e-b40b-4d73-9c81-1622676c73b5 with Priority: HIGHEST for action security_group_rules [ 871.018056] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-847d876e-b40b-4d73-9c81-1622676c73b5 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.018176] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-847d876e-b40b-4d73-9c81-1622676c73b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.018241] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-847d876e-b40b-4d73-9c81-1622676c73b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.018489] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-847d876e-b40b-4d73-9c81-1622676c73b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.018571] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('847d876e-b40b-4d73-9c81-1622676c73b5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.136048] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.136048] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.136048] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.136048] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.136048] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.136048] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7122ab9-4313-4173-8869-cf7cd16cccf0 is going to be created. [ 871.140448] env[65471]: INFO networking_nsxv3.common.synchronization [None req-0fb63f04-d7e6-4c07-af4a-217d20bdd13e tempest-ServerActionsTestJSON-1061383532 tempest-ServerActionsTestJSON-1061383532-project-member] Enqueued Resource ID: 847d876e-b40b-4d73-9c81-1622676c73b5 with Priority: HIGHEST for action security_group_rules [ 871.142029] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 847d876e-b40b-4d73-9c81-1622676c73b5 with Priority: HIGHEST for action security_group_rules [ 871.142369] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-847d876e-b40b-4d73-9c81-1622676c73b5 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.142557] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-847d876e-b40b-4d73-9c81-1622676c73b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.165607] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.165907] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.165991] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.166236] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.166813] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.178073] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7122ab9-4313-4173-8869-cf7cd16cccf0 in Status: UNINITIALIZED for 2s [ 871.259388] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e8869e0a-9385-48b2-ac90-589c8415df21 in Status: SUCCESS [ 871.259551] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.541651] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.541791] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.541791] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.541991] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.542055] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.542165] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 847d876e-b40b-4d73-9c81-1622676c73b5 already deleted. [ 871.542250] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-847d876e-b40b-4d73-9c81-1622676c73b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.542402] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-847d876e-b40b-4d73-9c81-1622676c73b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.542588] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-847d876e-b40b-4d73-9c81-1622676c73b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.542685] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('847d876e-b40b-4d73-9c81-1622676c73b5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.607456] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 927a7ac0-117d-4551-a979-a43f61af6c25 in Status: SUCCESS [ 871.607587] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-927a7ac0-117d-4551-a979-a43f61af6c25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.607825] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-927a7ac0-117d-4551-a979-a43f61af6c25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.608117] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-927a7ac0-117d-4551-a979-a43f61af6c25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.608335] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.608457] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.608526] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.608685] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.609194] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.609194] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-927a7ac0-117d-4551-a979-a43f61af6c25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.609194] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('927a7ac0-117d-4551-a979-a43f61af6c25',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.609813] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-927a7ac0-117d-4551-a979-a43f61af6c25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.610019] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-927a7ac0-117d-4551-a979-a43f61af6c25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.610351] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.610479] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.610558] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.610760] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.610842] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.612374] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('927a7ac0-117d-4551-a979-a43f61af6c25',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.067064] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.067204] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.067262] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.067468] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.068043] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.068043] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 847d876e-b40b-4d73-9c81-1622676c73b5 already deleted. [ 872.068043] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-847d876e-b40b-4d73-9c81-1622676c73b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.113608] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('927a7ac0-117d-4551-a979-a43f61af6c25',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.117496] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.117496] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.117496] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.117496] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.117496] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.117496] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.117496] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.117496] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.117496] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.117496] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.117496] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 927a7ac0-117d-4551-a979-a43f61af6c25 is going to be updated. [ 872.143787] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.145133] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.145133] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.145133] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.145133] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.155941] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 927a7ac0-117d-4551-a979-a43f61af6c25 in Status: IN_PROGRESS for 2s [ 872.618349] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 927a7ac0-117d-4551-a979-a43f61af6c25: rpc.has_security_group_logging(os_id): False [ 872.640800] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.640955] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.641028] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.641756] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.641756] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.641756] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.641756] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.642095] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.642095] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.642095] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.642095] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 927a7ac0-117d-4551-a979-a43f61af6c25 is going to be updated. [ 872.712630] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.712713] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.712801] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.713027] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.713279] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.728025] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 927a7ac0-117d-4551-a979-a43f61af6c25 in Status: IN_PROGRESS for 2s [ 872.954665] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba1a1760-87f6-4927-9e91-698752fe3531 in Status: SUCCESS [ 872.955472] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba1a1760-87f6-4927-9e91-698752fe3531 deletion is rescheduled due to dependency. [ 872.957456] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba1a1760-87f6-4927-9e91-698752fe3531" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.190645] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7122ab9-4313-4173-8869-cf7cd16cccf0 in Status: SUCCESS [ 873.190645] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7122ab9-4313-4173-8869-cf7cd16cccf0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.190645] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7122ab9-4313-4173-8869-cf7cd16cccf0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.190645] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7122ab9-4313-4173-8869-cf7cd16cccf0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.190645] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.190645] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.190645] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.190645] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.190645] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.190645] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7122ab9-4313-4173-8869-cf7cd16cccf0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.190645] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e7122ab9-4313-4173-8869-cf7cd16cccf0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.694949] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7122ab9-4313-4173-8869-cf7cd16cccf0 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.695226] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7122ab9-4313-4173-8869-cf7cd16cccf0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.695311] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7122ab9-4313-4173-8869-cf7cd16cccf0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.695613] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7122ab9-4313-4173-8869-cf7cd16cccf0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.695889] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.696052] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.696152] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.696394] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.696547] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.696690] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7122ab9-4313-4173-8869-cf7cd16cccf0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.696919] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7122ab9-4313-4173-8869-cf7cd16cccf0 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.697038] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7122ab9-4313-4173-8869-cf7cd16cccf0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.697104] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7122ab9-4313-4173-8869-cf7cd16cccf0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.697288] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7122ab9-4313-4173-8869-cf7cd16cccf0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.697440] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.697533] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.698555] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.698801] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.698914] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.699037] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7122ab9-4313-4173-8869-cf7cd16cccf0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.699176] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e7122ab9-4313-4173-8869-cf7cd16cccf0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.170739] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 927a7ac0-117d-4551-a979-a43f61af6c25 in Status: SUCCESS [ 874.170739] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 927a7ac0-117d-4551-a979-a43f61af6c25 deletion is rescheduled due to dependency. [ 874.170739] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-927a7ac0-117d-4551-a979-a43f61af6c25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.202477] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e7122ab9-4313-4173-8869-cf7cd16cccf0: rpc.has_security_group_logging(os_id): False [ 874.224344] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.224344] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.224344] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.224344] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.224344] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.224344] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.225123] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.225123] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.225123] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.225123] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.225359] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.225481] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.225614] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.225750] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.225873] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.226187] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.226351] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.226429] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.226671] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.226778] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.226889] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e7122ab9-4313-4173-8869-cf7cd16cccf0 is going to be created. [ 874.307334] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.307334] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.307334] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.307334] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.307334] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.320358] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e7122ab9-4313-4173-8869-cf7cd16cccf0 in Status: IN_PROGRESS for 2s [ 874.742302] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 927a7ac0-117d-4551-a979-a43f61af6c25 in Status: SUCCESS [ 874.742607] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-927a7ac0-117d-4551-a979-a43f61af6c25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.165924] env[65471]: INFO networking_nsxv3.common.synchronization [None req-4ead8a77-2642-4ac0-a541-5ff74c40f8de None None] Enqueued Resource ID: 70cfc5ba-60b0-479a-a5f4-377493ecf353 with Priority: HIGHEST for action port [ 875.166525] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70cfc5ba-60b0-479a-a5f4-377493ecf353 with Priority: HIGHEST for action port [ 875.166823] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-70cfc5ba-60b0-479a-a5f4-377493ecf353 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.167084] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-70cfc5ba-60b0-479a-a5f4-377493ecf353" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.167084] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-70cfc5ba-60b0-479a-a5f4-377493ecf353" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.168557] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-70cfc5ba-60b0-479a-a5f4-377493ecf353" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.168557] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70cfc5ba-60b0-479a-a5f4-377493ecf353',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.242041] env[65471]: INFO networking_nsxv3.common.synchronization [req-bf361400-188e-43a1-9a3c-7e5a2f457a93 req-b2f3bf6a-df75-4f3d-8a7f-9ec244485f66 tempest-SecurityGroupsTestJSON-778312627 tempest-SecurityGroupsTestJSON-778312627-project-member] Enqueued Resource ID: 76ee3a37-4552-4528-8f6c-448ca2d9b094 with Priority: HIGHEST for action security_group_members [ 875.242041] env[65471]: INFO networking_nsxv3.common.synchronization [req-bf361400-188e-43a1-9a3c-7e5a2f457a93 req-b2f3bf6a-df75-4f3d-8a7f-9ec244485f66 tempest-SecurityGroupsTestJSON-778312627 tempest-SecurityGroupsTestJSON-778312627-project-member] Enqueued Resource ID: ca7195fd-265e-439f-ac03-4bb1a006981b with Priority: HIGHEST for action security_group_members [ 875.242041] env[65471]: INFO networking_nsxv3.common.synchronization [req-bf361400-188e-43a1-9a3c-7e5a2f457a93 req-b2f3bf6a-df75-4f3d-8a7f-9ec244485f66 tempest-SecurityGroupsTestJSON-778312627 tempest-SecurityGroupsTestJSON-778312627-project-member] Enqueued Resource ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 with Priority: HIGHEST for action security_group_members [ 875.242041] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76ee3a37-4552-4528-8f6c-448ca2d9b094 with Priority: HIGHEST for action security_group_members [ 875.242041] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca7195fd-265e-439f-ac03-4bb1a006981b with Priority: HIGHEST for action security_group_members [ 875.242041] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 with Priority: HIGHEST for action security_group_members [ 875.242041] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-76ee3a37-4552-4528-8f6c-448ca2d9b094 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.242041] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76ee3a37-4552-4528-8f6c-448ca2d9b094" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.242041] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76ee3a37-4552-4528-8f6c-448ca2d9b094" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.242672] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76ee3a37-4552-4528-8f6c-448ca2d9b094" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.242672] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.242672] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.242672] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.242835] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.242876] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.242987] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76ee3a37-4552-4528-8f6c-448ca2d9b094',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.243886] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7195fd-265e-439f-ac03-4bb1a006981b taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.244000] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7195fd-265e-439f-ac03-4bb1a006981b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.244071] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7195fd-265e-439f-ac03-4bb1a006981b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.244231] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7195fd-265e-439f-ac03-4bb1a006981b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.244387] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.245474] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.245474] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.245474] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.245474] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.245474] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca7195fd-265e-439f-ac03-4bb1a006981b',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.246029] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.247841] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.247841] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.247841] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.247841] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.247841] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.247841] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.247841] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.247841] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.247841] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b60bf9ef-6e65-4c6d-87e2-33b6bcafa939',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.671203] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 70cfc5ba-60b0-479a-a5f4-377493ecf353 [ 875.672736] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.672882] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.673028] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.673181] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.673376] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.673416] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:70cfc5ba-60b0-479a-a5f4-377493ecf353 already deleted. [ 875.673486] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-70cfc5ba-60b0-479a-a5f4-377493ecf353" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.750996] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.750996] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.750996] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.750996] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.750996] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.750996] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.752189] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.752189] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.775122] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.775403] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.775519] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.775584] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.775814] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.775916] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.776018] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76ee3a37-4552-4528-8f6c-448ca2d9b094 is going to be updated. [ 875.777353] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.777593] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.797218] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.797218] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.797218] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.797218] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.797218] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.797218] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.797218] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca7195fd-265e-439f-ac03-4bb1a006981b is going to be updated. [ 875.799089] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.799089] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.799089] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.799089] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.799089] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.799089] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.799299] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.799299] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.799360] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 is going to be updated. [ 875.806502] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.806614] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.806655] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.807762] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.807762] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.815809] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76ee3a37-4552-4528-8f6c-448ca2d9b094 in Status: IN_PROGRESS for 2s [ 875.831433] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.831647] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.831719] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.831924] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.832076] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.833886] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.834010] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.834097] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.834269] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.834386] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.845567] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7195fd-265e-439f-ac03-4bb1a006981b in Status: IN_PROGRESS for 2s [ 875.849069] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 in Status: IN_PROGRESS for 2s [ 876.189177] env[65471]: INFO networking_nsxv3.common.synchronization [req-ca448883-c838-4967-a419-da4a6e28e9f2 req-5cc669a8-80c7-434d-a6e9-b2c052782662 tempest-ImagesTestJSON-650286870 tempest-ImagesTestJSON-650286870-project-member] Enqueued Resource ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f with Priority: HIGHEST for action security_group_members [ 876.190727] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f with Priority: HIGHEST for action security_group_members [ 876.192595] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-85af6c5e-2f9b-491d-9584-96c44b20f99f taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.192595] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.192595] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.192595] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.192828] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.192828] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.192907] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.193125] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.193200] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.193346] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85af6c5e-2f9b-491d-9584-96c44b20f99f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.336701] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e7122ab9-4313-4173-8869-cf7cd16cccf0 in Status: SUCCESS [ 876.336989] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e7122ab9-4313-4173-8869-cf7cd16cccf0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.409347] env[65471]: INFO networking_nsxv3.common.synchronization [req-4b182fc6-9bde-40d5-8262-d8a25679373a req-caede8ff-4fc3-4aba-b89f-3ca1fceaf79b tempest-ServerTagsTestJSON-885712363 tempest-ServerTagsTestJSON-885712363-project-member] Enqueued Resource ID: 6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf with Priority: HIGHEST for action security_group_members [ 876.409347] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf with Priority: HIGHEST for action security_group_members [ 876.412749] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.413082] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.413684] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.414043] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.414319] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.415967] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.415967] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.415967] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.415967] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.415967] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.678609] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock network-235 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.678816] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "network-235" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.678935] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "network-235" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.679742] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "network-235" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.680600] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.680600] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.680771] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.681690] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.681690] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.681690] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 876.681690] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 876.681690] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 876.681690] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 876.681950] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 876.681950] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 876.682081] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 876.696954] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.697099] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.697156] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.697429] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.697531] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.697737] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.697830] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.697893] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.698072] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.698151] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.698241] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f is going to be updated. [ 876.710046] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 876.710123] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 876.710313] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 876.710540] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "network-235" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.710995] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock port-1e6bbc2a-a3e7-473f-aacc-c83402278c87 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.711252] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "port-1e6bbc2a-a3e7-473f-aacc-c83402278c87" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.711400] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "port-1e6bbc2a-a3e7-473f-aacc-c83402278c87" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.711790] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "port-1e6bbc2a-a3e7-473f-aacc-c83402278c87" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.713015] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e6bbc2a-a3e7-473f-aacc-c83402278c87',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.730244] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.730244] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.730244] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.730467] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.730504] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.740993] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f in Status: IN_PROGRESS for 2s [ 876.920026] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.920381] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.920381] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.920776] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.920776] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.920925] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.920925] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.921042] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.922265] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.922372] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.926237] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf is going to be updated. [ 876.958119] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.958249] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.958779] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.958779] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.958779] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.968938] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf in Status: IN_PROGRESS for 2s [ 877.217132] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.217132] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.217282] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.217638] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.217782] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.217994] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Segment Port 1e6bbc2a-a3e7-473f-aacc-c83402278c87 not found, creating... [ 877.218406] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.218508] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.218600] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.218803] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.219076] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.219576] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.219576] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.219576] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.219737] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.219842] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.220393] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Resource: SegmentPort with ID: 1e6bbc2a-a3e7-473f-aacc-c83402278c87 is going to be created. [ 877.243047] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.243324] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.243472] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.244327] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.244327] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.244502] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "port-1e6bbc2a-a3e7-473f-aacc-c83402278c87" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.646934] env[65471]: INFO networking_nsxv3.common.synchronization [None req-fdd3ed8c-aee6-4cfc-a3df-a08536b479c4 None None] Enqueued Resource ID: 3d1aee9e-2d27-46e1-a703-56e201f538a8 with Priority: HIGHEST for action port [ 877.647983] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d1aee9e-2d27-46e1-a703-56e201f538a8 with Priority: HIGHEST for action port [ 877.648486] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-3d1aee9e-2d27-46e1-a703-56e201f538a8 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.648617] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3d1aee9e-2d27-46e1-a703-56e201f538a8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.648669] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3d1aee9e-2d27-46e1-a703-56e201f538a8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.648912] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3d1aee9e-2d27-46e1-a703-56e201f538a8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.649012] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d1aee9e-2d27-46e1-a703-56e201f538a8',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.832033] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76ee3a37-4552-4528-8f6c-448ca2d9b094 in Status: SUCCESS [ 877.832033] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76ee3a37-4552-4528-8f6c-448ca2d9b094 deletion is rescheduled due to dependency. [ 877.832033] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76ee3a37-4552-4528-8f6c-448ca2d9b094" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.863883] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7195fd-265e-439f-ac03-4bb1a006981b in Status: SUCCESS [ 877.864100] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca7195fd-265e-439f-ac03-4bb1a006981b deletion is rescheduled due to dependency. [ 877.864215] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7195fd-265e-439f-ac03-4bb1a006981b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.866031] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 in Status: SUCCESS [ 877.866163] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 deletion is rescheduled due to dependency. [ 877.866595] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.005181] env[65471]: INFO networking_nsxv3.common.synchronization [req-ca448883-c838-4967-a419-da4a6e28e9f2 req-9ea9716c-f897-4e35-b5b2-beb2ef609a3a service nova] Enqueued Resource ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f with Priority: HIGHEST for action security_group_rules [ 878.005361] env[65471]: INFO networking_nsxv3.common.synchronization [req-ca448883-c838-4967-a419-da4a6e28e9f2 req-9ea9716c-f897-4e35-b5b2-beb2ef609a3a service nova] Enqueued Resource ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f with Priority: HIGHEST for action security_group_members [ 878.005549] env[65471]: INFO networking_nsxv3.common.synchronization [req-ca448883-c838-4967-a419-da4a6e28e9f2 req-9ea9716c-f897-4e35-b5b2-beb2ef609a3a service nova] Enqueued Resource ID: 1e6bbc2a-a3e7-473f-aacc-c83402278c87 with Priority: HIGHEST for action port [ 878.006139] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f with Priority: HIGHEST for action security_group_rules [ 878.006279] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f with Priority: HIGHEST for action security_group_members [ 878.006379] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e6bbc2a-a3e7-473f-aacc-c83402278c87 with Priority: HIGHEST for action port [ 878.006648] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85af6c5e-2f9b-491d-9584-96c44b20f99f taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.006767] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.006832] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.007039] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.007122] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85af6c5e-2f9b-491d-9584-96c44b20f99f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.007975] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-85af6c5e-2f9b-491d-9584-96c44b20f99f taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.008090] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.008282] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e6bbc2a-a3e7-473f-aacc-c83402278c87 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.008419] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e6bbc2a-a3e7-473f-aacc-c83402278c87" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.008521] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e6bbc2a-a3e7-473f-aacc-c83402278c87" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.008603] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e6bbc2a-a3e7-473f-aacc-c83402278c87" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.008960] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e6bbc2a-a3e7-473f-aacc-c83402278c87',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.151237] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3d1aee9e-2d27-46e1-a703-56e201f538a8 [ 878.151680] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.151822] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.151889] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.152137] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.152230] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.152332] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3d1aee9e-2d27-46e1-a703-56e201f538a8 already deleted. [ 878.152417] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3d1aee9e-2d27-46e1-a703-56e201f538a8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.471398] env[65471]: INFO networking_nsxv3.common.synchronization [req-a68bbc64-1aef-4665-be25-24b312e9ca80 req-a6d145b3-1c3b-42ff-8f3e-f44a2ed83165 tempest-AttachInterfacesTestJSON-1197806586 tempest-AttachInterfacesTestJSON-1197806586-project-member] Enqueued Resource ID: e8869e0a-9385-48b2-ac90-589c8415df21 with Priority: HIGHEST for action security_group_members [ 878.471985] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8869e0a-9385-48b2-ac90-589c8415df21 with Priority: HIGHEST for action security_group_members [ 878.473039] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8869e0a-9385-48b2-ac90-589c8415df21 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.473174] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.473244] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.473440] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.473610] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.473704] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.473762] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.473944] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.474035] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.474130] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e8869e0a-9385-48b2-ac90-589c8415df21',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.509985] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-85af6c5e-2f9b-491d-9584-96c44b20f99f taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.510172] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.515451] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1e6bbc2a-a3e7-473f-aacc-c83402278c87 with status ACTIVE [ 878.515645] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.515765] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.515832] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.516060] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.516154] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.516330] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.516427] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.516492] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.516643] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.516720] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.517127] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.517256] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.517295] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.517435] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.517530] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.517593] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1e6bbc2a-a3e7-473f-aacc-c83402278c87 is going to be updated. [ 878.540211] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.540814] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.540899] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.541181] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.541332] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.541558] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e6bbc2a-a3e7-473f-aacc-c83402278c87" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.753504] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f in Status: SUCCESS [ 878.753814] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f deletion is rescheduled due to dependency. [ 878.753814] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.754448] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.754448] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.754448] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.754637] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.754637] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.754718] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.754819] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.754874] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85af6c5e-2f9b-491d-9584-96c44b20f99f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.976397] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.976553] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.976626] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.976844] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.976938] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.977166] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.977269] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.977332] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.977481] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.977557] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.977642] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8869e0a-9385-48b2-ac90-589c8415df21 is going to be updated. [ 878.988378] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf in Status: SUCCESS [ 878.988572] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf deletion is rescheduled due to dependency. [ 878.988684] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.026018] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.026191] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.026296] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.026505] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.026727] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.037873] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8869e0a-9385-48b2-ac90-589c8415df21 in Status: IN_PROGRESS for 2s [ 879.258070] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('85af6c5e-2f9b-491d-9584-96c44b20f99f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.760757] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('85af6c5e-2f9b-491d-9584-96c44b20f99f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.264228] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.264386] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.264463] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.264681] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.264777] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.264880] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f is going to be updated. [ 880.298868] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.299037] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.299114] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.299327] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.299478] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.309501] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f in Status: IN_PROGRESS for 2s [ 881.049592] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8869e0a-9385-48b2-ac90-589c8415df21 in Status: SUCCESS [ 881.049899] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8869e0a-9385-48b2-ac90-589c8415df21 deletion is rescheduled due to dependency. [ 881.050056] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.329643] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f in Status: SUCCESS [ 882.329950] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.330162] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.330318] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.330510] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.330628] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.330692] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.330854] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.330916] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.331012] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.331114] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('85af6c5e-2f9b-491d-9584-96c44b20f99f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.536989] env[65471]: INFO networking_nsxv3.common.synchronization [req-4b4c5067-c96d-4f6d-af41-895ad4852d7d req-91351dcc-edb5-486e-88eb-e3b76c2b8b73 tempest-AttachInterfacesTestJSON-1197806586 tempest-AttachInterfacesTestJSON-1197806586-project-member] Enqueued Resource ID: 1b605f75-31b8-4209-be69-e1c60e682aa5 with Priority: HIGHEST for action security_group_members [ 882.537566] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b605f75-31b8-4209-be69-e1c60e682aa5 with Priority: HIGHEST for action security_group_members [ 882.537927] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b605f75-31b8-4209-be69-e1c60e682aa5 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.538130] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b605f75-31b8-4209-be69-e1c60e682aa5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.538784] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b605f75-31b8-4209-be69-e1c60e682aa5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.538784] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b605f75-31b8-4209-be69-e1c60e682aa5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.538784] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.538784] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.538784] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.539309] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.539309] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.539309] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b605f75-31b8-4209-be69-e1c60e682aa5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.834427] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-85af6c5e-2f9b-491d-9584-96c44b20f99f taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.834631] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.834631] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.834738] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.834922] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.835037] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.835098] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.835260] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.835346] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.835480] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.835602] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-85af6c5e-2f9b-491d-9584-96c44b20f99f taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.835652] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.835732] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.835841] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.835987] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.836074] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.836157] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.836284] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.836320] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.836398] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.836486] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('85af6c5e-2f9b-491d-9584-96c44b20f99f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.043350] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.043350] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.043350] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.043350] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.063730] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.063730] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.064079] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.064079] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.064197] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.064197] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.064335] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b605f75-31b8-4209-be69-e1c60e682aa5 is going to be updated. [ 883.092045] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.092251] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.092298] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.092502] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.092647] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.104034] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b605f75-31b8-4209-be69-e1c60e682aa5 in Status: IN_PROGRESS for 2s [ 883.338585] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 85af6c5e-2f9b-491d-9584-96c44b20f99f: rpc.has_security_group_logging(os_id): False [ 883.358290] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.358530] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.358530] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.358818] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.358943] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.359224] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.359336] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.359526] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.359586] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.359627] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.359834] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.359982] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.359982] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.360143] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.360217] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.360418] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.360511] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.360555] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.360676] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.360745] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.360831] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f is going to be updated. [ 883.462906] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.463060] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.463133] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.463352] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.463497] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.476606] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f in Status: IN_PROGRESS for 2s [ 885.115707] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b605f75-31b8-4209-be69-e1c60e682aa5 in Status: SUCCESS [ 885.115958] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b605f75-31b8-4209-be69-e1c60e682aa5 deletion is rescheduled due to dependency. [ 885.115992] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b605f75-31b8-4209-be69-e1c60e682aa5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.489672] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f in Status: SUCCESS [ 885.489770] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.538374] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 887.538710] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 888.170225] env[65471]: INFO networking_nsxv3.common.synchronization [req-5f53d23c-961f-440e-a6e6-fb46ea3f08df req-41b9c26c-59c2-4fac-a676-dca96ff5eb60 tempest-ServerDiskConfigTestJSON-1443816332 tempest-ServerDiskConfigTestJSON-1443816332-project-member] Enqueued Resource ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e with Priority: HIGHEST for action security_group_members [ 888.170840] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e with Priority: HIGHEST for action security_group_members [ 888.171292] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.171431] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.171488] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.171862] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.171862] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.172048] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.172048] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.172214] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.172263] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.172315] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c8a6eda-c0ec-4e25-8652-6acf3d57da4e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.550333] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock network-537 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.550636] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "network-537" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.550670] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "network-537" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.550903] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "network-537" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.551175] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.551336] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.551438] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.551684] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.551826] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.552427] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 888.552589] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 888.552722] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 888.554662] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 888.554662] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 888.554662] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 888.554662] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 888.574582] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 888.574755] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 888.574931] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 888.575096] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "network-537" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.575501] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock port-bd6f3f83-ae46-4199-ac90-ab2de857bf1d taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.575733] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "port-bd6f3f83-ae46-4199-ac90-ab2de857bf1d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.575855] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "port-bd6f3f83-ae46-4199-ac90-ab2de857bf1d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.576184] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "port-bd6f3f83-ae46-4199-ac90-ab2de857bf1d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.576317] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd6f3f83-ae46-4199-ac90-ab2de857bf1d',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.674486] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.674671] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.674746] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.675000] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.675102] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.675318] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.675423] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.675487] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.675642] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.675719] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.675805] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e is going to be updated. [ 888.706012] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.706188] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.706263] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.706476] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.706624] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.716896] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e in Status: IN_PROGRESS for 2s [ 888.739336] env[65471]: INFO networking_nsxv3.common.synchronization [None req-28fb81f5-fec0-4a16-8ae0-6728eff2abac None None] Enqueued Resource ID: 2c3ab3dc-be85-4281-ad9c-96681273bb93 with Priority: HIGHEST for action port [ 888.740472] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c3ab3dc-be85-4281-ad9c-96681273bb93 with Priority: HIGHEST for action port [ 888.740472] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c3ab3dc-be85-4281-ad9c-96681273bb93 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.740472] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c3ab3dc-be85-4281-ad9c-96681273bb93" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.740613] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c3ab3dc-be85-4281-ad9c-96681273bb93" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.740917] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c3ab3dc-be85-4281-ad9c-96681273bb93" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.741030] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c3ab3dc-be85-4281-ad9c-96681273bb93',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.079433] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.079815] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.079946] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.080315] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.080570] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.080819] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Segment Port bd6f3f83-ae46-4199-ac90-ab2de857bf1d not found, creating... [ 889.081351] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.081523] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.081674] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.082104] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.082320] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.082797] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.083056] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.083236] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.083564] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.083758] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.083987] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Resource: SegmentPort with ID: bd6f3f83-ae46-4199-ac90-ab2de857bf1d is going to be created. [ 889.106962] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.107283] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.107499] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.107852] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.108182] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.108461] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "port-bd6f3f83-ae46-4199-ac90-ab2de857bf1d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.243599] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2c3ab3dc-be85-4281-ad9c-96681273bb93 [ 889.243980] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.244202] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.244284] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.244519] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.244614] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.244812] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2c3ab3dc-be85-4281-ad9c-96681273bb93 already deleted. [ 889.244812] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c3ab3dc-be85-4281-ad9c-96681273bb93" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.839349] env[65471]: INFO networking_nsxv3.common.synchronization [req-5f53d23c-961f-440e-a6e6-fb46ea3f08df req-7eceab88-1dce-446c-a3af-2cfdf49e2212 service nova] Enqueued Resource ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e with Priority: HIGHEST for action security_group_rules [ 889.839589] env[65471]: INFO networking_nsxv3.common.synchronization [req-5f53d23c-961f-440e-a6e6-fb46ea3f08df req-7eceab88-1dce-446c-a3af-2cfdf49e2212 service nova] Enqueued Resource ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e with Priority: HIGHEST for action security_group_members [ 889.839669] env[65471]: INFO networking_nsxv3.common.synchronization [req-5f53d23c-961f-440e-a6e6-fb46ea3f08df req-7eceab88-1dce-446c-a3af-2cfdf49e2212 service nova] Enqueued Resource ID: bd6f3f83-ae46-4199-ac90-ab2de857bf1d with Priority: HIGHEST for action port [ 889.840246] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e with Priority: HIGHEST for action security_group_rules [ 889.840381] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e with Priority: HIGHEST for action security_group_members [ 889.840480] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd6f3f83-ae46-4199-ac90-ab2de857bf1d with Priority: HIGHEST for action port [ 889.843535] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.843535] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.843535] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.843535] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.843535] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1c8a6eda-c0ec-4e25-8652-6acf3d57da4e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.843975] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.843975] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.844404] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-bd6f3f83-ae46-4199-ac90-ab2de857bf1d taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.846560] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bd6f3f83-ae46-4199-ac90-ab2de857bf1d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.846560] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bd6f3f83-ae46-4199-ac90-ab2de857bf1d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.846560] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bd6f3f83-ae46-4199-ac90-ab2de857bf1d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.846560] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd6f3f83-ae46-4199-ac90-ab2de857bf1d',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.349488] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.349708] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.349889] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bd6f3f83-ae46-4199-ac90-ab2de857bf1d with status ACTIVE [ 890.350068] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.350194] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.350274] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.350431] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.350510] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.350790] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.350790] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.350956] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.350956] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.351070] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.354787] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.354787] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.354787] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.354787] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.354787] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.354787] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bd6f3f83-ae46-4199-ac90-ab2de857bf1d is going to be updated. [ 890.373663] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.373861] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.374092] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.374146] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.374280] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.374482] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bd6f3f83-ae46-4199-ac90-ab2de857bf1d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.729343] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e in Status: SUCCESS [ 890.729343] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e deletion is rescheduled due to dependency. [ 890.729343] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.729343] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.729343] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.729629] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.729700] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.729741] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.729881] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.729961] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.730073] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c8a6eda-c0ec-4e25-8652-6acf3d57da4e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.217750] env[65471]: INFO networking_nsxv3.common.synchronization [None req-e1e5b149-0b2b-4221-b916-f7457e8d84f7 None None] Enqueued Resource ID: 018bd14b-c22e-4edc-a3a0-603ce1dbfbd6 with Priority: HIGHEST for action port [ 891.218166] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 018bd14b-c22e-4edc-a3a0-603ce1dbfbd6 with Priority: HIGHEST for action port [ 891.218470] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-018bd14b-c22e-4edc-a3a0-603ce1dbfbd6 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.218591] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-018bd14b-c22e-4edc-a3a0-603ce1dbfbd6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.218658] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-018bd14b-c22e-4edc-a3a0-603ce1dbfbd6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.218941] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-018bd14b-c22e-4edc-a3a0-603ce1dbfbd6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.219070] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('018bd14b-c22e-4edc-a3a0-603ce1dbfbd6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.234289] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1c8a6eda-c0ec-4e25-8652-6acf3d57da4e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.721215] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 018bd14b-c22e-4edc-a3a0-603ce1dbfbd6 [ 891.721613] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.721834] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.721922] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.722213] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.722345] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.722457] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:018bd14b-c22e-4edc-a3a0-603ce1dbfbd6 already deleted. [ 891.722584] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-018bd14b-c22e-4edc-a3a0-603ce1dbfbd6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.737381] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1c8a6eda-c0ec-4e25-8652-6acf3d57da4e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.239650] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.239984] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.239984] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.240241] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.240365] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.240450] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e is going to be updated. [ 892.272046] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.272262] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.272412] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.272538] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.272723] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.282308] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e in Status: IN_PROGRESS for 2s [ 893.179079] env[65471]: INFO networking_nsxv3.common.synchronization [req-61d2fb9a-a5cd-4fd2-8732-ebe2f7c7e2a7 req-fda78a55-4776-4a7d-8964-bcd17c494121 tempest-ServersWithSpecificFlavorTestJSON-1911677354 tempest-ServersWithSpecificFlavorTestJSON-1911677354-project-member] Enqueued Resource ID: 57387769-3919-42b1-a3d7-3d45bcef516d with Priority: HIGHEST for action security_group_members [ 893.181727] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57387769-3919-42b1-a3d7-3d45bcef516d with Priority: HIGHEST for action security_group_members [ 893.182139] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-57387769-3919-42b1-a3d7-3d45bcef516d taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.182277] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57387769-3919-42b1-a3d7-3d45bcef516d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.182340] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57387769-3919-42b1-a3d7-3d45bcef516d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.182865] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57387769-3919-42b1-a3d7-3d45bcef516d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.182865] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.182865] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.183308] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.183308] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.183308] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.183308] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57387769-3919-42b1-a3d7-3d45bcef516d',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.685446] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.685797] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.685797] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.686105] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.686242] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.686483] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.686619] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.686704] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.686886] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.687016] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.687117] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57387769-3919-42b1-a3d7-3d45bcef516d is going to be updated. [ 893.717155] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.717483] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.717483] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.717602] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.717708] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.730058] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57387769-3919-42b1-a3d7-3d45bcef516d in Status: IN_PROGRESS for 2s [ 894.302902] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e in Status: SUCCESS [ 894.303323] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.303420] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.303630] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.304326] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.304326] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.304326] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.304326] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.304326] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.304769] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.304769] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1c8a6eda-c0ec-4e25-8652-6acf3d57da4e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.808676] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.809065] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.809065] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.809065] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.809185] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.809274] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.809343] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.809508] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.809679] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.809773] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.809926] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.810037] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.810097] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.810236] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.810375] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.810462] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.810583] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.810692] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.810726] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.810808] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.810892] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1c8a6eda-c0ec-4e25-8652-6acf3d57da4e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.314511] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e: rpc.has_security_group_logging(os_id): False [ 895.333923] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.334108] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.334151] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.334643] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.334827] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.335030] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.335145] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.335209] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.335389] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.335472] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.335665] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.335758] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.335818] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.335957] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.336187] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.336635] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.338103] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.338103] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.338103] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.338103] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.338103] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e is going to be updated. [ 895.401759] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.401759] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.401759] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.401759] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.402033] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.415537] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e in Status: IN_PROGRESS for 2s [ 895.436057] env[65471]: INFO networking_nsxv3.common.synchronization [req-82ffcd3b-ec41-47e1-a06a-88b9b30cd75f req-52e62b00-b8f5-4b54-9c8c-ce2de390c9f6 tempest-ServerActionsTestOtherA-1623203122 tempest-ServerActionsTestOtherA-1623203122-project-member] Enqueued Resource ID: e7122ab9-4313-4173-8869-cf7cd16cccf0 with Priority: HIGHEST for action security_group_members [ 895.436888] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7122ab9-4313-4173-8869-cf7cd16cccf0 with Priority: HIGHEST for action security_group_members [ 895.437364] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7122ab9-4313-4173-8869-cf7cd16cccf0 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.437683] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7122ab9-4313-4173-8869-cf7cd16cccf0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.437950] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7122ab9-4313-4173-8869-cf7cd16cccf0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.438264] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7122ab9-4313-4173-8869-cf7cd16cccf0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.438584] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.440030] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.440030] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.440030] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.440030] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.440030] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7122ab9-4313-4173-8869-cf7cd16cccf0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.740357] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57387769-3919-42b1-a3d7-3d45bcef516d in Status: SUCCESS [ 895.740559] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57387769-3919-42b1-a3d7-3d45bcef516d deletion is rescheduled due to dependency. [ 895.740673] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57387769-3919-42b1-a3d7-3d45bcef516d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.941992] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.942329] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.942380] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.942680] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.943364] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.943364] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.943364] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.943364] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.943364] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.943652] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.943652] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7122ab9-4313-4173-8869-cf7cd16cccf0 is going to be updated. [ 895.984333] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.984403] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.984515] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.984636] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.984776] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.011265] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7122ab9-4313-4173-8869-cf7cd16cccf0 in Status: IN_PROGRESS for 2s [ 897.431362] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e in Status: SUCCESS [ 897.431362] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.818438] env[65471]: INFO networking_nsxv3.common.synchronization [req-363a58d2-b892-4b6d-a3ca-2faa123794c8 req-a5c3910d-3974-4f29-9d78-e5c4b6cf2284 tempest-ServerAddressesNegativeTestJSON-919296396 tempest-ServerAddressesNegativeTestJSON-919296396-project-member] Enqueued Resource ID: c76874fd-d1f3-4f5c-96ab-39e9f4dcd034 with Priority: HIGHEST for action security_group_members [ 897.818438] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c76874fd-d1f3-4f5c-96ab-39e9f4dcd034 with Priority: HIGHEST for action security_group_members [ 897.818438] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-c76874fd-d1f3-4f5c-96ab-39e9f4dcd034 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.818438] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c76874fd-d1f3-4f5c-96ab-39e9f4dcd034" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.818438] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c76874fd-d1f3-4f5c-96ab-39e9f4dcd034" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.818438] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c76874fd-d1f3-4f5c-96ab-39e9f4dcd034" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.818438] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.818861] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.818861] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.818861] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.818861] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.818954] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c76874fd-d1f3-4f5c-96ab-39e9f4dcd034',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.021254] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7122ab9-4313-4173-8869-cf7cd16cccf0 in Status: SUCCESS [ 898.021429] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7122ab9-4313-4173-8869-cf7cd16cccf0 deletion is rescheduled due to dependency. [ 898.021545] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7122ab9-4313-4173-8869-cf7cd16cccf0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.204794] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock network-701 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.204982] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "network-701" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.205127] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "network-701" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.205451] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "network-701" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.205709] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.205863] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.205977] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.206205] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.206340] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.206539] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 898.206647] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 898.206754] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 898.206865] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 898.206965] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 898.207080] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 898.207255] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 898.226652] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 898.226819] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 898.226958] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 898.227150] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "network-701" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.227484] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock port-364462e0-fa6e-48db-9b1d-cf286f17caa5 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.227719] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "port-364462e0-fa6e-48db-9b1d-cf286f17caa5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.227863] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "port-364462e0-fa6e-48db-9b1d-cf286f17caa5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.228201] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "port-364462e0-fa6e-48db-9b1d-cf286f17caa5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.228338] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('364462e0-fa6e-48db-9b1d-cf286f17caa5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.321199] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.321364] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.321433] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.321661] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.321848] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.322113] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.322263] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.322371] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.322532] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.322639] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.322735] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c76874fd-d1f3-4f5c-96ab-39e9f4dcd034 already deleted. [ 898.322853] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c76874fd-d1f3-4f5c-96ab-39e9f4dcd034" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.731377] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.734023] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.734023] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.734023] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.734023] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.734023] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Segment Port 364462e0-fa6e-48db-9b1d-cf286f17caa5 not found, creating... [ 898.734023] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.734023] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.734023] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.734023] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.734023] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.734487] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.734846] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.735101] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.735413] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.735649] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.735922] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Resource: SegmentPort with ID: 364462e0-fa6e-48db-9b1d-cf286f17caa5 is going to be created. [ 898.760233] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.760233] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.760233] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.760233] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.760233] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.760233] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "port-364462e0-fa6e-48db-9b1d-cf286f17caa5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.184230] env[65471]: INFO networking_nsxv3.common.synchronization [None req-fc39363a-784b-44ec-9a37-68788aeac8ee None None] Enqueued Resource ID: d47cbdac-f289-4a1f-9f80-b433ab43dd24 with Priority: HIGHEST for action port [ 899.185129] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d47cbdac-f289-4a1f-9f80-b433ab43dd24 with Priority: HIGHEST for action port [ 899.185129] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-d47cbdac-f289-4a1f-9f80-b433ab43dd24 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.185129] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d47cbdac-f289-4a1f-9f80-b433ab43dd24" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.185129] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d47cbdac-f289-4a1f-9f80-b433ab43dd24" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.185374] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d47cbdac-f289-4a1f-9f80-b433ab43dd24" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.185464] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d47cbdac-f289-4a1f-9f80-b433ab43dd24',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.466032] env[65471]: INFO networking_nsxv3.common.synchronization [req-363a58d2-b892-4b6d-a3ca-2faa123794c8 req-fb43a1a7-64c7-457e-848e-cd41e3abebf5 service nova] Enqueued Resource ID: c76874fd-d1f3-4f5c-96ab-39e9f4dcd034 with Priority: HIGHEST for action security_group_rules [ 899.466201] env[65471]: INFO networking_nsxv3.common.synchronization [req-363a58d2-b892-4b6d-a3ca-2faa123794c8 req-fb43a1a7-64c7-457e-848e-cd41e3abebf5 service nova] Enqueued Resource ID: c76874fd-d1f3-4f5c-96ab-39e9f4dcd034 with Priority: HIGHEST for action security_group_members [ 899.466583] env[65471]: INFO networking_nsxv3.common.synchronization [req-363a58d2-b892-4b6d-a3ca-2faa123794c8 req-fb43a1a7-64c7-457e-848e-cd41e3abebf5 service nova] Enqueued Resource ID: 364462e0-fa6e-48db-9b1d-cf286f17caa5 with Priority: HIGHEST for action port [ 899.467151] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c76874fd-d1f3-4f5c-96ab-39e9f4dcd034 with Priority: HIGHEST for action security_group_rules [ 899.468465] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c76874fd-d1f3-4f5c-96ab-39e9f4dcd034 with Priority: HIGHEST for action security_group_members [ 899.468731] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 364462e0-fa6e-48db-9b1d-cf286f17caa5 with Priority: HIGHEST for action port [ 899.469031] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c76874fd-d1f3-4f5c-96ab-39e9f4dcd034 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.469156] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c76874fd-d1f3-4f5c-96ab-39e9f4dcd034" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.469212] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c76874fd-d1f3-4f5c-96ab-39e9f4dcd034" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.469774] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c76874fd-d1f3-4f5c-96ab-39e9f4dcd034" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.469885] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c76874fd-d1f3-4f5c-96ab-39e9f4dcd034',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.471889] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-c76874fd-d1f3-4f5c-96ab-39e9f4dcd034 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.471889] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c76874fd-d1f3-4f5c-96ab-39e9f4dcd034" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.471889] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c76874fd-d1f3-4f5c-96ab-39e9f4dcd034" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.471889] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c76874fd-d1f3-4f5c-96ab-39e9f4dcd034" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.471889] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.471889] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.471889] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.472232] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.472232] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.472232] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c76874fd-d1f3-4f5c-96ab-39e9f4dcd034',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.473210] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-364462e0-fa6e-48db-9b1d-cf286f17caa5 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.473472] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-364462e0-fa6e-48db-9b1d-cf286f17caa5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.473472] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-364462e0-fa6e-48db-9b1d-cf286f17caa5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.473647] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-364462e0-fa6e-48db-9b1d-cf286f17caa5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.473715] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('364462e0-fa6e-48db-9b1d-cf286f17caa5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.687402] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d47cbdac-f289-4a1f-9f80-b433ab43dd24 [ 899.687731] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.687907] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.688017] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.688345] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.690789] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.690789] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d47cbdac-f289-4a1f-9f80-b433ab43dd24 already deleted. [ 899.690789] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d47cbdac-f289-4a1f-9f80-b433ab43dd24" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.975538] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-c76874fd-d1f3-4f5c-96ab-39e9f4dcd034 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.975969] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c76874fd-d1f3-4f5c-96ab-39e9f4dcd034" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.975969] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c76874fd-d1f3-4f5c-96ab-39e9f4dcd034',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.977371] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 364462e0-fa6e-48db-9b1d-cf286f17caa5 with status ACTIVE [ 899.977371] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.977371] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.977371] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.977555] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.977646] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.977824] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.977919] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.977988] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.978204] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.978316] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.978569] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.978681] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.978681] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.978814] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.978892] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.978977] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 364462e0-fa6e-48db-9b1d-cf286f17caa5 is going to be updated. [ 900.014400] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.014544] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.014614] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.014823] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.014957] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.015219] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-364462e0-fa6e-48db-9b1d-cf286f17caa5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.407253] env[65471]: INFO networking_nsxv3.common.synchronization [req-1844c901-54f1-4a4b-97cc-e7089f1db48d req-26bd8f21-25f6-446c-b61c-b62acdb9a3be tempest-ServerRescueTestJSON-1224779364 tempest-ServerRescueTestJSON-1224779364-project-member] Enqueued Resource ID: a70c8576-d6c6-406f-8ebf-d5fb66c56b95 with Priority: HIGHEST for action security_group_members [ 900.407677] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a70c8576-d6c6-406f-8ebf-d5fb66c56b95 with Priority: HIGHEST for action security_group_members [ 900.408363] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-a70c8576-d6c6-406f-8ebf-d5fb66c56b95 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.408363] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a70c8576-d6c6-406f-8ebf-d5fb66c56b95" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.408363] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a70c8576-d6c6-406f-8ebf-d5fb66c56b95" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.408363] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a70c8576-d6c6-406f-8ebf-d5fb66c56b95" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.408621] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.408621] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.408704] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.409024] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.409024] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.409024] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a70c8576-d6c6-406f-8ebf-d5fb66c56b95',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.484326] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c76874fd-d1f3-4f5c-96ab-39e9f4dcd034',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.759523] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock network-187 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.759745] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "network-187" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.759894] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "network-187" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.760180] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "network-187" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.760521] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.760629] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.760662] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.760879] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.761024] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.761233] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 900.761340] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 900.761453] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 900.761556] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 900.761658] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 900.761798] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 900.761937] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 900.783993] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 900.783993] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 900.783993] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 900.783993] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "network-187" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.783993] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock port-4b814ab2-16dc-489e-bbba-d8cbfa552769 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.783993] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "port-4b814ab2-16dc-489e-bbba-d8cbfa552769" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.783993] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "port-4b814ab2-16dc-489e-bbba-d8cbfa552769" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.784283] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "port-4b814ab2-16dc-489e-bbba-d8cbfa552769" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.784283] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b814ab2-16dc-489e-bbba-d8cbfa552769',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.911286] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a70c8576-d6c6-406f-8ebf-d5fb66c56b95',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.987365] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.988403] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.988482] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.988703] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.988855] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.988980] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c76874fd-d1f3-4f5c-96ab-39e9f4dcd034 is going to be created. [ 901.031350] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.031542] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.031542] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.031879] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.032317] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.047060] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c76874fd-d1f3-4f5c-96ab-39e9f4dcd034 in Status: UNINITIALIZED for 2s [ 901.289476] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.289476] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.289476] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.289476] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.289476] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.289899] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Segment Port 4b814ab2-16dc-489e-bbba-d8cbfa552769 not found, creating... [ 901.290100] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.290298] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.290453] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.290699] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.290858] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.291179] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.291364] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.291504] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.291797] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.291989] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.292503] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Resource: SegmentPort with ID: 4b814ab2-16dc-489e-bbba-d8cbfa552769 is going to be created. [ 901.332126] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.332324] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.332651] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.332777] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.335044] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.335044] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "port-4b814ab2-16dc-489e-bbba-d8cbfa552769" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.416376] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a70c8576-d6c6-406f-8ebf-d5fb66c56b95',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.918251] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.918431] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.918804] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.919202] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.919202] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.919292] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a70c8576-d6c6-406f-8ebf-d5fb66c56b95 is going to be updated. [ 901.951940] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.951940] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.952167] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.954496] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.954496] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.962611] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a70c8576-d6c6-406f-8ebf-d5fb66c56b95 in Status: IN_PROGRESS for 2s [ 902.021421] env[65471]: INFO networking_nsxv3.common.synchronization [req-1844c901-54f1-4a4b-97cc-e7089f1db48d req-60d3b055-abd8-4a29-8133-57a8a34aa905 service nova] Enqueued Resource ID: a70c8576-d6c6-406f-8ebf-d5fb66c56b95 with Priority: HIGHEST for action security_group_rules [ 902.021844] env[65471]: INFO networking_nsxv3.common.synchronization [req-1844c901-54f1-4a4b-97cc-e7089f1db48d req-60d3b055-abd8-4a29-8133-57a8a34aa905 service nova] Enqueued Resource ID: a70c8576-d6c6-406f-8ebf-d5fb66c56b95 with Priority: HIGHEST for action security_group_members [ 902.021942] env[65471]: INFO networking_nsxv3.common.synchronization [req-1844c901-54f1-4a4b-97cc-e7089f1db48d req-60d3b055-abd8-4a29-8133-57a8a34aa905 service nova] Enqueued Resource ID: 4b814ab2-16dc-489e-bbba-d8cbfa552769 with Priority: HIGHEST for action port [ 902.022706] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a70c8576-d6c6-406f-8ebf-d5fb66c56b95 with Priority: HIGHEST for action security_group_rules [ 902.022914] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a70c8576-d6c6-406f-8ebf-d5fb66c56b95 with Priority: HIGHEST for action security_group_members [ 902.023303] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b814ab2-16dc-489e-bbba-d8cbfa552769 with Priority: HIGHEST for action port [ 902.023690] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a70c8576-d6c6-406f-8ebf-d5fb66c56b95 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.024026] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a70c8576-d6c6-406f-8ebf-d5fb66c56b95" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.024156] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a70c8576-d6c6-406f-8ebf-d5fb66c56b95" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.024460] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a70c8576-d6c6-406f-8ebf-d5fb66c56b95" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.024609] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a70c8576-d6c6-406f-8ebf-d5fb66c56b95',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.026154] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-a70c8576-d6c6-406f-8ebf-d5fb66c56b95 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.026260] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a70c8576-d6c6-406f-8ebf-d5fb66c56b95" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.026503] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-4b814ab2-16dc-489e-bbba-d8cbfa552769 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.026622] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4b814ab2-16dc-489e-bbba-d8cbfa552769" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.026716] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4b814ab2-16dc-489e-bbba-d8cbfa552769" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.026895] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4b814ab2-16dc-489e-bbba-d8cbfa552769" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.027025] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b814ab2-16dc-489e-bbba-d8cbfa552769',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.169385] env[65471]: INFO networking_nsxv3.common.synchronization [None req-05446be7-0acf-47a2-88b1-0c25f2a0c5a4 None None] Enqueued Resource ID: d4570fee-7e64-4c08-adad-009bfe1414d6 with Priority: HIGHEST for action port [ 902.169781] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4570fee-7e64-4c08-adad-009bfe1414d6 with Priority: HIGHEST for action port [ 902.170428] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-d4570fee-7e64-4c08-adad-009bfe1414d6 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.170536] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d4570fee-7e64-4c08-adad-009bfe1414d6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.170601] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d4570fee-7e64-4c08-adad-009bfe1414d6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.170885] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d4570fee-7e64-4c08-adad-009bfe1414d6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.170962] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d4570fee-7e64-4c08-adad-009bfe1414d6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.531122] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-a70c8576-d6c6-406f-8ebf-d5fb66c56b95 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.531122] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a70c8576-d6c6-406f-8ebf-d5fb66c56b95" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.531122] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4b814ab2-16dc-489e-bbba-d8cbfa552769 with status ACTIVE [ 902.531122] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.531122] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.531122] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.531122] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.531122] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.531122] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.531122] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.531122] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.531573] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.531573] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.531631] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.531767] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.531862] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.532040] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.532127] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.532211] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4b814ab2-16dc-489e-bbba-d8cbfa552769 is going to be updated. [ 902.557556] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.557697] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.557768] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.557990] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.558143] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.558300] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4b814ab2-16dc-489e-bbba-d8cbfa552769" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.673611] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d4570fee-7e64-4c08-adad-009bfe1414d6 [ 902.673611] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.673738] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.673738] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.673957] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.674099] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.674211] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d4570fee-7e64-4c08-adad-009bfe1414d6 already deleted. [ 902.675032] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d4570fee-7e64-4c08-adad-009bfe1414d6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.058352] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c76874fd-d1f3-4f5c-96ab-39e9f4dcd034 in Status: SUCCESS [ 903.058718] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c76874fd-d1f3-4f5c-96ab-39e9f4dcd034" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.058806] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c76874fd-d1f3-4f5c-96ab-39e9f4dcd034" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.059083] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c76874fd-d1f3-4f5c-96ab-39e9f4dcd034" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.059296] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.059432] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.059515] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.059733] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.059888] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.060064] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c76874fd-d1f3-4f5c-96ab-39e9f4dcd034" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.060131] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c76874fd-d1f3-4f5c-96ab-39e9f4dcd034',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.565536] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-c76874fd-d1f3-4f5c-96ab-39e9f4dcd034 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.565706] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c76874fd-d1f3-4f5c-96ab-39e9f4dcd034" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.565777] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c76874fd-d1f3-4f5c-96ab-39e9f4dcd034" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.566657] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c76874fd-d1f3-4f5c-96ab-39e9f4dcd034" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.566862] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.566989] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.567067] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.567252] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.567336] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.570576] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c76874fd-d1f3-4f5c-96ab-39e9f4dcd034" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.570576] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-c76874fd-d1f3-4f5c-96ab-39e9f4dcd034 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.570576] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c76874fd-d1f3-4f5c-96ab-39e9f4dcd034" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.570576] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c76874fd-d1f3-4f5c-96ab-39e9f4dcd034" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.570576] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c76874fd-d1f3-4f5c-96ab-39e9f4dcd034" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.570576] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.570576] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.570576] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.570576] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.570576] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.570576] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c76874fd-d1f3-4f5c-96ab-39e9f4dcd034" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.570576] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c76874fd-d1f3-4f5c-96ab-39e9f4dcd034',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.977453] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a70c8576-d6c6-406f-8ebf-d5fb66c56b95 in Status: SUCCESS [ 903.977711] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a70c8576-d6c6-406f-8ebf-d5fb66c56b95" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.977875] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a70c8576-d6c6-406f-8ebf-d5fb66c56b95" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.978177] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a70c8576-d6c6-406f-8ebf-d5fb66c56b95" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.978362] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.978481] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.978548] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.978707] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.978793] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.978892] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a70c8576-d6c6-406f-8ebf-d5fb66c56b95',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.072391] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c76874fd-d1f3-4f5c-96ab-39e9f4dcd034: rpc.has_security_group_logging(os_id): False [ 904.093110] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.093310] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.093441] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.093896] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.093896] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.093896] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.094122] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.094122] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.094191] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.094311] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.094457] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.094544] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.094881] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.094881] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.094881] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.095103] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.095103] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.095285] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.095285] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.095372] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.095417] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c76874fd-d1f3-4f5c-96ab-39e9f4dcd034 is going to be created. [ 904.172395] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.172545] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.172617] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.172831] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.173014] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.191516] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c76874fd-d1f3-4f5c-96ab-39e9f4dcd034 in Status: IN_PROGRESS for 2s [ 904.482636] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a70c8576-d6c6-406f-8ebf-d5fb66c56b95',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.986099] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a70c8576-d6c6-406f-8ebf-d5fb66c56b95',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.491120] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.491463] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.491463] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.492597] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.492597] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.492597] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a70c8576-d6c6-406f-8ebf-d5fb66c56b95 is going to be updated. [ 905.525599] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.525753] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.525833] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.526058] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.526201] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.535710] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a70c8576-d6c6-406f-8ebf-d5fb66c56b95 in Status: IN_PROGRESS for 2s [ 906.204877] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c76874fd-d1f3-4f5c-96ab-39e9f4dcd034 in Status: SUCCESS [ 906.205059] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c76874fd-d1f3-4f5c-96ab-39e9f4dcd034" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.171096] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 907.171096] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 907.547510] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a70c8576-d6c6-406f-8ebf-d5fb66c56b95 in Status: SUCCESS [ 907.547667] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a70c8576-d6c6-406f-8ebf-d5fb66c56b95" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.547851] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a70c8576-d6c6-406f-8ebf-d5fb66c56b95" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.548177] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a70c8576-d6c6-406f-8ebf-d5fb66c56b95" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.548381] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.548498] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.548562] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.548720] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.548803] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.548890] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a70c8576-d6c6-406f-8ebf-d5fb66c56b95" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.548981] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a70c8576-d6c6-406f-8ebf-d5fb66c56b95',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.052228] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-a70c8576-d6c6-406f-8ebf-d5fb66c56b95 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.052228] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a70c8576-d6c6-406f-8ebf-d5fb66c56b95" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.052458] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a70c8576-d6c6-406f-8ebf-d5fb66c56b95" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.052548] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a70c8576-d6c6-406f-8ebf-d5fb66c56b95" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.052721] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.052813] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.052892] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.053131] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.053131] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.053225] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a70c8576-d6c6-406f-8ebf-d5fb66c56b95" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.053400] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-a70c8576-d6c6-406f-8ebf-d5fb66c56b95 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.053551] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a70c8576-d6c6-406f-8ebf-d5fb66c56b95" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.053551] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a70c8576-d6c6-406f-8ebf-d5fb66c56b95" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.053699] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a70c8576-d6c6-406f-8ebf-d5fb66c56b95" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.053837] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.053927] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.053986] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.054327] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.054327] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.054327] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a70c8576-d6c6-406f-8ebf-d5fb66c56b95" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.054327] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a70c8576-d6c6-406f-8ebf-d5fb66c56b95',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.557274] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a70c8576-d6c6-406f-8ebf-d5fb66c56b95: rpc.has_security_group_logging(os_id): False [ 908.577501] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.577713] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.577713] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.577927] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.578027] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.578220] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.578318] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.578381] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.578534] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.578648] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.578881] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.578983] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.579058] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.579216] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.579394] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.579617] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.579757] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.579810] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.579941] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.580033] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.580121] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a70c8576-d6c6-406f-8ebf-d5fb66c56b95 is going to be updated. [ 908.648811] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.648811] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.648811] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.649066] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.649157] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.662510] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a70c8576-d6c6-406f-8ebf-d5fb66c56b95 in Status: IN_PROGRESS for 2s [ 909.330843] env[65471]: INFO networking_nsxv3.common.synchronization [req-b6571559-ea95-4fd1-b4c2-3b4151ce96d8 req-89ca7b9d-7e8f-4814-8456-c9cb879004fc tempest-ServersAdminTestJSON-1197360877 tempest-ServersAdminTestJSON-1197360877-project-member] Enqueued Resource ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 with Priority: HIGHEST for action security_group_members [ 909.331634] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 with Priority: HIGHEST for action security_group_members [ 909.332723] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4ca8456-5b21-4080-b762-7b52a4837eb1 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.332723] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.332723] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.332723] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.332723] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.333155] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.333155] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.333155] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.333155] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.333286] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4ca8456-5b21-4080-b762-7b52a4837eb1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.836345] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.836632] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.836632] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.836796] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.864636] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.864636] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.864636] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.864636] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.864636] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.864636] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.864636] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 is going to be updated. [ 909.889479] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.889635] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.889773] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.889991] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.890148] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.898700] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 in Status: IN_PROGRESS for 2s [ 910.676816] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a70c8576-d6c6-406f-8ebf-d5fb66c56b95 in Status: SUCCESS [ 910.677217] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a70c8576-d6c6-406f-8ebf-d5fb66c56b95" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.861823] env[65471]: INFO networking_nsxv3.common.synchronization [req-8cd2ed87-283f-463a-9237-cdc79bd74780 req-0019a895-01a0-4d87-9d65-85e05e7bb4dc tempest-ServerAddressesNegativeTestJSON-919296396 tempest-ServerAddressesNegativeTestJSON-919296396-project-member] Enqueued Resource ID: c76874fd-d1f3-4f5c-96ab-39e9f4dcd034 with Priority: HIGHEST for action security_group_members [ 910.862452] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c76874fd-d1f3-4f5c-96ab-39e9f4dcd034 with Priority: HIGHEST for action security_group_members [ 910.863123] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-c76874fd-d1f3-4f5c-96ab-39e9f4dcd034 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.863123] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c76874fd-d1f3-4f5c-96ab-39e9f4dcd034" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.863123] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c76874fd-d1f3-4f5c-96ab-39e9f4dcd034" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.864141] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c76874fd-d1f3-4f5c-96ab-39e9f4dcd034" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.864141] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.864141] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.864141] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.864141] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.864141] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.864141] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c76874fd-d1f3-4f5c-96ab-39e9f4dcd034',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.366192] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.366472] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.366527] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.366869] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.366869] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.367037] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.367142] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.367176] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.367444] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.367531] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.367619] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c76874fd-d1f3-4f5c-96ab-39e9f4dcd034 is going to be updated. [ 911.399658] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.399865] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.399865] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.400098] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.400465] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.410068] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c76874fd-d1f3-4f5c-96ab-39e9f4dcd034 in Status: IN_PROGRESS for 2s [ 911.909645] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 in Status: SUCCESS [ 911.909981] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 deletion is rescheduled due to dependency. [ 911.909981] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.420078] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c76874fd-d1f3-4f5c-96ab-39e9f4dcd034 in Status: SUCCESS [ 913.420347] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c76874fd-d1f3-4f5c-96ab-39e9f4dcd034 deletion is rescheduled due to dependency. [ 913.420413] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c76874fd-d1f3-4f5c-96ab-39e9f4dcd034" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.864113] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 915.864427] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 918.004756] env[65471]: INFO networking_nsxv3.common.synchronization [req-f81f84d7-64a2-45a5-80fb-3fc8e18a686c req-ce195456-cd17-4f17-8cdb-4a8022164bea tempest-ServerActionsTestJSON-1061383532 tempest-ServerActionsTestJSON-1061383532-project-member] Enqueued Resource ID: 847d876e-b40b-4d73-9c81-1622676c73b5 with Priority: HIGHEST for action security_group_members [ 918.005484] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 847d876e-b40b-4d73-9c81-1622676c73b5 with Priority: HIGHEST for action security_group_members [ 918.005940] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-847d876e-b40b-4d73-9c81-1622676c73b5 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.006141] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-847d876e-b40b-4d73-9c81-1622676c73b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.006248] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-847d876e-b40b-4d73-9c81-1622676c73b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.006592] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-847d876e-b40b-4d73-9c81-1622676c73b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.006827] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.006992] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.007094] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.007268] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.007355] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.007450] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('847d876e-b40b-4d73-9c81-1622676c73b5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.500029] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock network-487 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.500245] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "network-487" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.500368] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "network-487" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.500626] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "network-487" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.500883] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.501569] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.501767] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.502079] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.502237] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.502455] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 918.502568] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 918.502692] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 918.502808] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 918.502941] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 918.503050] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 918.503185] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 918.510630] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.510897] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.510897] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.511027] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.511167] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.511304] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.511410] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.511478] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.511590] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.511656] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.511739] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 847d876e-b40b-4d73-9c81-1622676c73b5 already deleted. [ 918.511806] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-847d876e-b40b-4d73-9c81-1622676c73b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.525085] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 918.525293] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 918.525391] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 918.525564] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "network-487" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.525871] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock port-96900c2d-7858-417c-be2f-a989705db3c9 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.526050] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "port-96900c2d-7858-417c-be2f-a989705db3c9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.526169] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "port-96900c2d-7858-417c-be2f-a989705db3c9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.526500] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "port-96900c2d-7858-417c-be2f-a989705db3c9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.526653] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96900c2d-7858-417c-be2f-a989705db3c9',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.029844] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.029844] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.029844] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.030292] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.030292] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.030881] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Segment Port 96900c2d-7858-417c-be2f-a989705db3c9 not found, creating... [ 919.030881] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.030881] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.031144] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.031144] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.031284] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.031718] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.031718] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.031912] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.032064] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.032198] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.032335] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Resource: SegmentPort with ID: 96900c2d-7858-417c-be2f-a989705db3c9 is going to be created. [ 919.055509] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.055721] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.055840] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.056150] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.056378] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.056608] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "port-96900c2d-7858-417c-be2f-a989705db3c9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.155517] env[65471]: INFO networking_nsxv3.common.synchronization [None req-57f70330-2d08-4b50-b48b-d9608f186524 None None] Enqueued Resource ID: b5d822a4-b00c-44f2-8c21-f705537349d1 with Priority: HIGHEST for action port [ 919.157286] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5d822a4-b00c-44f2-8c21-f705537349d1 with Priority: HIGHEST for action port [ 919.157286] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-b5d822a4-b00c-44f2-8c21-f705537349d1 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.157286] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b5d822a4-b00c-44f2-8c21-f705537349d1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.157286] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b5d822a4-b00c-44f2-8c21-f705537349d1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.157286] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b5d822a4-b00c-44f2-8c21-f705537349d1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.157286] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5d822a4-b00c-44f2-8c21-f705537349d1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.662104] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b5d822a4-b00c-44f2-8c21-f705537349d1 [ 919.662104] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.662104] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.662104] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.662104] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.662104] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.662104] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b5d822a4-b00c-44f2-8c21-f705537349d1 already deleted. [ 919.662104] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b5d822a4-b00c-44f2-8c21-f705537349d1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.767761] env[65471]: INFO networking_nsxv3.common.synchronization [req-f81f84d7-64a2-45a5-80fb-3fc8e18a686c req-3f73fbce-a643-4b89-b413-f97a596ddf87 service nova] Enqueued Resource ID: 847d876e-b40b-4d73-9c81-1622676c73b5 with Priority: HIGHEST for action security_group_rules [ 919.768014] env[65471]: INFO networking_nsxv3.common.synchronization [req-f81f84d7-64a2-45a5-80fb-3fc8e18a686c req-3f73fbce-a643-4b89-b413-f97a596ddf87 service nova] Enqueued Resource ID: 847d876e-b40b-4d73-9c81-1622676c73b5 with Priority: HIGHEST for action security_group_members [ 919.768176] env[65471]: INFO networking_nsxv3.common.synchronization [req-f81f84d7-64a2-45a5-80fb-3fc8e18a686c req-3f73fbce-a643-4b89-b413-f97a596ddf87 service nova] Enqueued Resource ID: 96900c2d-7858-417c-be2f-a989705db3c9 with Priority: HIGHEST for action port [ 919.768728] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 847d876e-b40b-4d73-9c81-1622676c73b5 with Priority: HIGHEST for action security_group_rules [ 919.768870] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 847d876e-b40b-4d73-9c81-1622676c73b5 with Priority: HIGHEST for action security_group_members [ 919.768970] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96900c2d-7858-417c-be2f-a989705db3c9 with Priority: HIGHEST for action port [ 919.769529] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-847d876e-b40b-4d73-9c81-1622676c73b5 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.769663] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-847d876e-b40b-4d73-9c81-1622676c73b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.769821] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-847d876e-b40b-4d73-9c81-1622676c73b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.770120] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-847d876e-b40b-4d73-9c81-1622676c73b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.770209] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('847d876e-b40b-4d73-9c81-1622676c73b5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.771677] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-847d876e-b40b-4d73-9c81-1622676c73b5 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.771677] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-847d876e-b40b-4d73-9c81-1622676c73b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.771789] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-847d876e-b40b-4d73-9c81-1622676c73b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.771977] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-847d876e-b40b-4d73-9c81-1622676c73b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.772163] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.772277] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.772342] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.772516] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.772618] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.772712] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('847d876e-b40b-4d73-9c81-1622676c73b5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.773688] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-96900c2d-7858-417c-be2f-a989705db3c9 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.773786] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-96900c2d-7858-417c-be2f-a989705db3c9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.773892] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-96900c2d-7858-417c-be2f-a989705db3c9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.774213] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-96900c2d-7858-417c-be2f-a989705db3c9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.774311] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96900c2d-7858-417c-be2f-a989705db3c9',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.069210] env[65471]: INFO networking_nsxv3.common.synchronization [req-e65f1660-e5d0-4fa3-b68f-2c0cf7b9b57d req-66bdc7fc-a038-4955-8ae9-77b50b5de477 tempest-DeleteServersTestJSON-72429361 tempest-DeleteServersTestJSON-72429361-project-member] Enqueued Resource ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 with Priority: HIGHEST for action security_group_members [ 920.069210] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 with Priority: HIGHEST for action security_group_members [ 920.069210] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-c35d5123-3fe1-447f-aedc-8112e5faa2b6 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.069210] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.069888] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.070328] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.070703] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.070973] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.071632] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.071632] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.071632] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.071632] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c35d5123-3fe1-447f-aedc-8112e5faa2b6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.278236] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('847d876e-b40b-4d73-9c81-1622676c73b5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.279465] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-847d876e-b40b-4d73-9c81-1622676c73b5 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.279465] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-847d876e-b40b-4d73-9c81-1622676c73b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.279465] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 96900c2d-7858-417c-be2f-a989705db3c9 with status ACTIVE [ 920.279783] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.279783] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.279783] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.284098] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.284098] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.284098] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.284098] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.284098] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.284098] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.284098] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.284098] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.284098] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.284098] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.284098] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.284098] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.284098] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 96900c2d-7858-417c-be2f-a989705db3c9 is going to be updated. [ 920.305519] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.305807] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.305807] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.306014] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.306220] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.306386] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-96900c2d-7858-417c-be2f-a989705db3c9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.475697] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock network-80 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.475967] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "network-80" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.476102] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "network-80" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.476429] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "network-80" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.476688] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.477152] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.477152] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.477305] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.477305] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.477521] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 920.477608] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 920.477833] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 920.477833] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 920.477911] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 920.478229] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 920.478296] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 920.503079] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 920.503285] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 920.503451] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 920.503658] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "network-80" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.504040] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock port-e39c9adf-76fd-4bd3-b933-66c4b0a759b6 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.504373] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "port-e39c9adf-76fd-4bd3-b933-66c4b0a759b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.504463] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "port-e39c9adf-76fd-4bd3-b933-66c4b0a759b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.504746] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "port-e39c9adf-76fd-4bd3-b933-66c4b0a759b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.504905] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e39c9adf-76fd-4bd3-b933-66c4b0a759b6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.575426] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.575426] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.575426] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.575550] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.575604] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.575808] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.575905] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.575970] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.576133] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.576209] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.576294] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 already deleted. [ 920.576371] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.785186] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('847d876e-b40b-4d73-9c81-1622676c73b5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.007827] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.008198] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.008198] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.008860] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.009140] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.009200] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Segment Port e39c9adf-76fd-4bd3-b933-66c4b0a759b6 not found, creating... [ 921.009439] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.009595] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.009708] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.009974] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.010097] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.010368] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.010519] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.010632] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.010836] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.010965] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.011148] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Resource: SegmentPort with ID: e39c9adf-76fd-4bd3-b933-66c4b0a759b6 is going to be created. [ 921.032627] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.032836] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.033043] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.033359] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.033557] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.033781] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "port-e39c9adf-76fd-4bd3-b933-66c4b0a759b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.284146] env[65471]: INFO networking_nsxv3.common.synchronization [None req-ba400f0b-2b0f-44c1-b08f-16b17bb052c3 None None] Enqueued Resource ID: 4e6d09ee-9d81-4c52-ba95-bb2e4090f623 with Priority: HIGHEST for action port [ 921.284840] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e6d09ee-9d81-4c52-ba95-bb2e4090f623 with Priority: HIGHEST for action port [ 921.285341] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e6d09ee-9d81-4c52-ba95-bb2e4090f623 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.285466] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e6d09ee-9d81-4c52-ba95-bb2e4090f623" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.285536] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e6d09ee-9d81-4c52-ba95-bb2e4090f623" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.285776] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e6d09ee-9d81-4c52-ba95-bb2e4090f623" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.285859] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e6d09ee-9d81-4c52-ba95-bb2e4090f623',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.288863] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.288863] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.288863] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.288863] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.288863] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.288863] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 847d876e-b40b-4d73-9c81-1622676c73b5 is going to be created. [ 921.324256] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.324388] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.324462] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.324665] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.324823] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.336880] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 847d876e-b40b-4d73-9c81-1622676c73b5 in Status: UNINITIALIZED for 2s [ 921.741176] env[65471]: INFO networking_nsxv3.common.synchronization [req-e65f1660-e5d0-4fa3-b68f-2c0cf7b9b57d req-3dace940-c0c9-46ac-86a4-ec2779dad492 service nova] Enqueued Resource ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 with Priority: HIGHEST for action security_group_rules [ 921.741176] env[65471]: INFO networking_nsxv3.common.synchronization [req-e65f1660-e5d0-4fa3-b68f-2c0cf7b9b57d req-3dace940-c0c9-46ac-86a4-ec2779dad492 service nova] Enqueued Resource ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 with Priority: HIGHEST for action security_group_members [ 921.741176] env[65471]: INFO networking_nsxv3.common.synchronization [req-e65f1660-e5d0-4fa3-b68f-2c0cf7b9b57d req-3dace940-c0c9-46ac-86a4-ec2779dad492 service nova] Enqueued Resource ID: e39c9adf-76fd-4bd3-b933-66c4b0a759b6 with Priority: HIGHEST for action port [ 921.741176] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 with Priority: HIGHEST for action security_group_rules [ 921.741722] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 with Priority: HIGHEST for action security_group_members [ 921.742099] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e39c9adf-76fd-4bd3-b933-66c4b0a759b6 with Priority: HIGHEST for action port [ 921.742513] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c35d5123-3fe1-447f-aedc-8112e5faa2b6 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.743130] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.745760] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.745760] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.745760] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c35d5123-3fe1-447f-aedc-8112e5faa2b6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.748309] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-c35d5123-3fe1-447f-aedc-8112e5faa2b6 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.748309] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.748309] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.748309] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.748309] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.748309] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.748309] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.748309] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.749122] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.749122] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c35d5123-3fe1-447f-aedc-8112e5faa2b6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.750626] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-e39c9adf-76fd-4bd3-b933-66c4b0a759b6 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.750626] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e39c9adf-76fd-4bd3-b933-66c4b0a759b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.750626] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e39c9adf-76fd-4bd3-b933-66c4b0a759b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.750626] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e39c9adf-76fd-4bd3-b933-66c4b0a759b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.750813] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e39c9adf-76fd-4bd3-b933-66c4b0a759b6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.789064] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4e6d09ee-9d81-4c52-ba95-bb2e4090f623 [ 921.789064] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.789064] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.789064] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.789064] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.789064] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.789064] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4e6d09ee-9d81-4c52-ba95-bb2e4090f623 already deleted. [ 921.789064] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e6d09ee-9d81-4c52-ba95-bb2e4090f623" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.105388] env[65471]: INFO networking_nsxv3.common.synchronization [None req-64cdd72d-5a44-4418-9774-15b2a1c8f5f4 None None] Enqueued Resource ID: d364615f-a7bd-48d0-bfdd-185495a0d5be with Priority: HIGHEST for action port [ 922.105388] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d364615f-a7bd-48d0-bfdd-185495a0d5be with Priority: HIGHEST for action port [ 922.105388] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-d364615f-a7bd-48d0-bfdd-185495a0d5be taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.105704] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d364615f-a7bd-48d0-bfdd-185495a0d5be" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.107397] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d364615f-a7bd-48d0-bfdd-185495a0d5be" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.108174] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d364615f-a7bd-48d0-bfdd-185495a0d5be" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.108730] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d364615f-a7bd-48d0-bfdd-185495a0d5be',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.247517] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-c35d5123-3fe1-447f-aedc-8112e5faa2b6 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.247699] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.252225] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c35d5123-3fe1-447f-aedc-8112e5faa2b6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.254366] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e39c9adf-76fd-4bd3-b933-66c4b0a759b6 with status ACTIVE [ 922.254366] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.254366] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.254366] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.254610] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.254610] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.256777] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.256777] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.256777] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.256777] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.256777] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.256777] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.256777] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.256777] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.256777] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.256777] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.256777] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e39c9adf-76fd-4bd3-b933-66c4b0a759b6 is going to be updated. [ 922.286187] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.286495] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.286495] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.286638] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.286777] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.286956] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e39c9adf-76fd-4bd3-b933-66c4b0a759b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.614566] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d364615f-a7bd-48d0-bfdd-185495a0d5be [ 922.614566] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.615479] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.615479] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.615479] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.615479] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.615479] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d364615f-a7bd-48d0-bfdd-185495a0d5be already deleted. [ 922.615479] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d364615f-a7bd-48d0-bfdd-185495a0d5be" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.755682] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c35d5123-3fe1-447f-aedc-8112e5faa2b6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.261644] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.261952] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.262233] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.262420] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.262556] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.262670] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 is going to be created. [ 923.294765] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.295359] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.295359] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.295359] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.295494] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.317538] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 in Status: UNINITIALIZED for 2s [ 923.351888] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 847d876e-b40b-4d73-9c81-1622676c73b5 in Status: SUCCESS [ 923.351888] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-847d876e-b40b-4d73-9c81-1622676c73b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.352076] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-847d876e-b40b-4d73-9c81-1622676c73b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.352278] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-847d876e-b40b-4d73-9c81-1622676c73b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.352501] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.352643] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.352712] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.352883] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.352964] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.353064] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-847d876e-b40b-4d73-9c81-1622676c73b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.353164] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('847d876e-b40b-4d73-9c81-1622676c73b5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.858706] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('847d876e-b40b-4d73-9c81-1622676c73b5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.362294] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 847d876e-b40b-4d73-9c81-1622676c73b5: rpc.has_security_group_logging(os_id): False [ 924.393778] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.393778] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.393778] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.393778] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.393778] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.393778] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.393778] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.393778] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.393778] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.393778] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.393778] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 847d876e-b40b-4d73-9c81-1622676c73b5 is going to be created. [ 924.468603] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.468814] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.468915] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.469182] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.469462] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.481884] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 847d876e-b40b-4d73-9c81-1622676c73b5 in Status: IN_PROGRESS for 2s [ 924.701655] env[65471]: INFO networking_nsxv3.common.synchronization [None req-c74a135e-33aa-4bff-a202-728b40d2647d None None] Enqueued Resource ID: 0d8ec0cd-0c1f-491d-b18a-6ba50ecb4463 with Priority: HIGHEST for action port [ 924.705980] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d8ec0cd-0c1f-491d-b18a-6ba50ecb4463 with Priority: HIGHEST for action port [ 924.706392] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-0d8ec0cd-0c1f-491d-b18a-6ba50ecb4463 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.706663] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0d8ec0cd-0c1f-491d-b18a-6ba50ecb4463" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.706663] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0d8ec0cd-0c1f-491d-b18a-6ba50ecb4463" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.706825] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0d8ec0cd-0c1f-491d-b18a-6ba50ecb4463" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.706925] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d8ec0cd-0c1f-491d-b18a-6ba50ecb4463',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.211053] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0d8ec0cd-0c1f-491d-b18a-6ba50ecb4463 [ 925.211318] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.211529] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.211529] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.211835] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.212026] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.212224] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0d8ec0cd-0c1f-491d-b18a-6ba50ecb4463 already deleted. [ 925.212366] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0d8ec0cd-0c1f-491d-b18a-6ba50ecb4463" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.332411] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 in Status: SUCCESS [ 925.332605] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.332829] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.333122] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.333324] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.333473] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.333551] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.333757] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.333869] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.334176] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.334176] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c35d5123-3fe1-447f-aedc-8112e5faa2b6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.836928] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-c35d5123-3fe1-447f-aedc-8112e5faa2b6 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.837535] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.837535] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.837535] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.837667] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.837775] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.837825] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.837981] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.838116] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.838217] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.838379] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-c35d5123-3fe1-447f-aedc-8112e5faa2b6 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.838483] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.838819] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.839072] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.839265] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.839413] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.839493] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.839769] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.840008] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.840193] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.840312] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c35d5123-3fe1-447f-aedc-8112e5faa2b6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.858903] env[65471]: INFO networking_nsxv3.common.synchronization [req-039d548d-987d-4df5-a2bf-0cc14beda1af req-02746ecd-8657-4a3a-a8da-46fa4ce68a82 tempest-ServersTestMultiNic-44021310 tempest-ServersTestMultiNic-44021310-project-member] Enqueued Resource ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea with Priority: HIGHEST for action security_group_members [ 925.859542] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea with Priority: HIGHEST for action security_group_members [ 925.859754] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.859907] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.859969] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.861788] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.862063] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.862415] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.862415] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.862415] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.862848] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.862848] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('918bf7c8-0ca6-4052-a0a9-38a8db5664ea',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.274085] env[65471]: INFO networking_nsxv3.common.synchronization [None req-0910ac64-b84f-4efb-93c7-287f77292d01 None None] Enqueued Resource ID: 1e732a7b-2de7-40ed-bf13-512222602297 with Priority: HIGHEST for action port [ 926.274725] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e732a7b-2de7-40ed-bf13-512222602297 with Priority: HIGHEST for action port [ 926.275041] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e732a7b-2de7-40ed-bf13-512222602297 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.275170] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e732a7b-2de7-40ed-bf13-512222602297" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.275238] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e732a7b-2de7-40ed-bf13-512222602297" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.275510] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e732a7b-2de7-40ed-bf13-512222602297" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.275600] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e732a7b-2de7-40ed-bf13-512222602297',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.344284] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c35d5123-3fe1-447f-aedc-8112e5faa2b6: rpc.has_security_group_logging(os_id): False [ 926.350865] env[65471]: INFO networking_nsxv3.common.synchronization [req-039d548d-987d-4df5-a2bf-0cc14beda1af req-e6021bbf-0ba9-4c7a-b7bc-70dd636dbbe0 tempest-ServersTestMultiNic-44021310 tempest-ServersTestMultiNic-44021310-project-member] Enqueued Resource ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea with Priority: HIGHEST for action security_group_members [ 926.351402] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea with Priority: HIGHEST for action security_group_members [ 926.351716] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.351813] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.362738] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.362919] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.364230] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.364230] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.364230] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.364230] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.364230] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.364230] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.364230] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.364230] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.364230] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.364609] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.364609] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.364609] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.364696] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.364960] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.365188] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.365324] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.365509] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.365635] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.365782] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 is going to be created. [ 926.367108] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.367211] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.367273] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.367438] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.367520] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.367689] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.367778] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.367838] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.367967] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.368064] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.368146] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea already deleted. [ 926.368239] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.368705] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.368857] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.368999] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.369110] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.369168] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.369328] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.369402] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.369490] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('918bf7c8-0ca6-4052-a0a9-38a8db5664ea',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.432819] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.432819] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.432819] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.432819] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.432819] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.444034] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 in Status: IN_PROGRESS for 2s [ 926.496144] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 847d876e-b40b-4d73-9c81-1622676c73b5 in Status: SUCCESS [ 926.496447] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-847d876e-b40b-4d73-9c81-1622676c73b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.779207] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1e732a7b-2de7-40ed-bf13-512222602297 [ 926.779524] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.779668] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.779741] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.780022] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.780118] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.780221] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1e732a7b-2de7-40ed-bf13-512222602297 already deleted. [ 926.780304] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e732a7b-2de7-40ed-bf13-512222602297" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.866775] env[65471]: INFO networking_nsxv3.common.synchronization [req-039d548d-987d-4df5-a2bf-0cc14beda1af req-8a62be3c-687b-445c-acf6-a7f3e2cb8f3a tempest-ServersTestMultiNic-44021310 tempest-ServersTestMultiNic-44021310-project-member] Enqueued Resource ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea with Priority: HIGHEST for action security_group_members [ 926.867657] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea with Priority: HIGHEST for action security_group_members [ 926.869472] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.869472] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.872864] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.873151] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.873388] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.873672] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.873820] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.874157] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.874321] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.874396] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.874652] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.874850] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.874929] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea already deleted. [ 926.875063] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.875755] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.876345] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.878484] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.878484] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.878484] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.878484] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.878484] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.878484] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('918bf7c8-0ca6-4052-a0a9-38a8db5664ea',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.381167] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.381360] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.381399] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.381616] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.381702] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.381904] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.382057] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.382108] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.382285] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.382375] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.382461] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea already deleted. [ 927.382540] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.384503] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock network-699 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.384703] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "network-699" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.384836] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "network-699" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.385232] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "network-699" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.385412] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.385565] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.385679] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.385883] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.386026] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.386232] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 927.386448] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 927.386448] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 927.386623] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 927.386661] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 927.386789] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 927.386923] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 927.407830] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 927.408106] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 927.408196] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 927.408442] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "network-699" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.408692] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock port-177e190b-e490-4728-af4a-018423080a3a taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.408989] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "port-177e190b-e490-4728-af4a-018423080a3a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.409128] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "port-177e190b-e490-4728-af4a-018423080a3a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.409484] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "port-177e190b-e490-4728-af4a-018423080a3a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.409638] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('177e190b-e490-4728-af4a-018423080a3a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.912726] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.913862] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.914051] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.914363] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.914507] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.914668] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Segment Port 177e190b-e490-4728-af4a-018423080a3a not found, creating... [ 927.914955] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.915140] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.915257] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.915482] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.915621] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.915907] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.916166] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.916328] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.916658] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.917425] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.917650] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Resource: SegmentPort with ID: 177e190b-e490-4728-af4a-018423080a3a is going to be created. [ 927.940825] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.941189] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.941375] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.941732] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.942176] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.942443] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "port-177e190b-e490-4728-af4a-018423080a3a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.460329] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 in Status: SUCCESS [ 928.460620] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.598509] env[65471]: INFO networking_nsxv3.common.synchronization [None req-ade94554-5b3a-421e-bf52-c62f280b7a46 tempest-AttachInterfacesTestJSON-1197806586 tempest-AttachInterfacesTestJSON-1197806586-project-member] Enqueued Resource ID: c6d2b8aa-4881-48a5-899c-b24d6eb08e70 with Priority: HIGHEST for action security_group_rules [ 928.599171] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6d2b8aa-4881-48a5-899c-b24d6eb08e70 with Priority: HIGHEST for action security_group_rules [ 928.599531] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c6d2b8aa-4881-48a5-899c-b24d6eb08e70 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.599659] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c6d2b8aa-4881-48a5-899c-b24d6eb08e70" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.599724] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c6d2b8aa-4881-48a5-899c-b24d6eb08e70" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.599984] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c6d2b8aa-4881-48a5-899c-b24d6eb08e70" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.600819] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c6d2b8aa-4881-48a5-899c-b24d6eb08e70',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.714282] env[65471]: INFO networking_nsxv3.common.synchronization [req-039d548d-987d-4df5-a2bf-0cc14beda1af req-8a6dee16-7e8c-418f-8e4f-e78156c9d749 service nova] Enqueued Resource ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea with Priority: HIGHEST for action security_group_rules [ 928.714453] env[65471]: INFO networking_nsxv3.common.synchronization [req-039d548d-987d-4df5-a2bf-0cc14beda1af req-8a6dee16-7e8c-418f-8e4f-e78156c9d749 service nova] Enqueued Resource ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea with Priority: HIGHEST for action security_group_members [ 928.714603] env[65471]: INFO networking_nsxv3.common.synchronization [req-039d548d-987d-4df5-a2bf-0cc14beda1af req-8a6dee16-7e8c-418f-8e4f-e78156c9d749 service nova] Enqueued Resource ID: 177e190b-e490-4728-af4a-018423080a3a with Priority: HIGHEST for action port [ 928.716249] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea with Priority: HIGHEST for action security_group_rules [ 928.716249] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea with Priority: HIGHEST for action security_group_members [ 928.716249] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 177e190b-e490-4728-af4a-018423080a3a with Priority: HIGHEST for action port [ 928.716249] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-918bf7c8-0ca6-4052-a0a9-38a8db5664ea taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.716569] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.716672] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.717049] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.717167] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('918bf7c8-0ca6-4052-a0a9-38a8db5664ea',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.718293] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.718864] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.718864] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.718980] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.719205] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.719322] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.719402] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.719594] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.719722] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.719860] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('918bf7c8-0ca6-4052-a0a9-38a8db5664ea',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.720788] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-177e190b-e490-4728-af4a-018423080a3a taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.722597] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-177e190b-e490-4728-af4a-018423080a3a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.722597] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-177e190b-e490-4728-af4a-018423080a3a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.722751] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-177e190b-e490-4728-af4a-018423080a3a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.722881] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('177e190b-e490-4728-af4a-018423080a3a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.869416] env[65471]: INFO networking_nsxv3.common.synchronization [None req-9976d6ee-4f5a-4fa2-b05a-09a5e1ce840f tempest-AttachInterfacesTestJSON-1197806586 tempest-AttachInterfacesTestJSON-1197806586-project-member] Enqueued Resource ID: c6d2b8aa-4881-48a5-899c-b24d6eb08e70 with Priority: HIGHEST for action security_group_rules [ 928.869996] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6d2b8aa-4881-48a5-899c-b24d6eb08e70 with Priority: HIGHEST for action security_group_rules [ 928.870518] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c6d2b8aa-4881-48a5-899c-b24d6eb08e70 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.870761] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c6d2b8aa-4881-48a5-899c-b24d6eb08e70" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.035648] env[65471]: INFO networking_nsxv3.common.synchronization [None req-894c5b9f-5c52-4d3f-9f80-ceaca5c70447 None None] Enqueued Resource ID: ee86495f-644c-4e65-94bb-c5a637e4f1cf with Priority: HIGHEST for action port [ 929.035648] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee86495f-644c-4e65-94bb-c5a637e4f1cf with Priority: HIGHEST for action port [ 929.035648] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-ee86495f-644c-4e65-94bb-c5a637e4f1cf taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.035648] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ee86495f-644c-4e65-94bb-c5a637e4f1cf" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.037348] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ee86495f-644c-4e65-94bb-c5a637e4f1cf" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.037843] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ee86495f-644c-4e65-94bb-c5a637e4f1cf" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.037843] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee86495f-644c-4e65-94bb-c5a637e4f1cf',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.129205] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.129446] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.129582] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.129900] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.130383] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.130383] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c6d2b8aa-4881-48a5-899c-b24d6eb08e70 already deleted. [ 929.130383] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c6d2b8aa-4881-48a5-899c-b24d6eb08e70" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.131132] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c6d2b8aa-4881-48a5-899c-b24d6eb08e70" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.131912] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c6d2b8aa-4881-48a5-899c-b24d6eb08e70" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.131912] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c6d2b8aa-4881-48a5-899c-b24d6eb08e70',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.225524] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('918bf7c8-0ca6-4052-a0a9-38a8db5664ea',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.226822] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.227049] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.227343] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 177e190b-e490-4728-af4a-018423080a3a with status ACTIVE [ 929.227872] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.229067] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.229185] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.230073] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.230222] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.230507] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.230658] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.230726] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.230911] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.230990] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.231219] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.231365] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.231419] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.232675] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.232675] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.232675] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 177e190b-e490-4728-af4a-018423080a3a is going to be updated. [ 929.255539] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.255745] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.255745] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.255965] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.256124] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.256289] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-177e190b-e490-4728-af4a-018423080a3a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.541018] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ee86495f-644c-4e65-94bb-c5a637e4f1cf [ 929.541414] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.541815] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.541815] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.542121] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.542374] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.542449] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ee86495f-644c-4e65-94bb-c5a637e4f1cf already deleted. [ 929.542515] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ee86495f-644c-4e65-94bb-c5a637e4f1cf" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.652038] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.652038] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.652038] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.652038] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.652038] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.652038] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c6d2b8aa-4881-48a5-899c-b24d6eb08e70 already deleted. [ 929.652038] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c6d2b8aa-4881-48a5-899c-b24d6eb08e70" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.653736] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock network-159 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.653940] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "network-159" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.654039] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "network-159" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.654329] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "network-159" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.654688] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.654787] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.654842] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.655491] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.655491] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.655491] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 929.655491] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 929.655672] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 929.655672] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 929.655732] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 929.655833] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 929.656160] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 929.681463] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 929.681463] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 929.681463] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 929.681463] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "network-159" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.681653] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock port-de111b63-62f4-4477-b957-54eaa851b630 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.681811] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "port-de111b63-62f4-4477-b957-54eaa851b630" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.682044] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "port-de111b63-62f4-4477-b957-54eaa851b630" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.682444] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "port-de111b63-62f4-4477-b957-54eaa851b630" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.682587] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de111b63-62f4-4477-b957-54eaa851b630',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.728042] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('918bf7c8-0ca6-4052-a0a9-38a8db5664ea',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.185059] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.185484] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.185484] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.185716] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.185867] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.186070] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Segment Port de111b63-62f4-4477-b957-54eaa851b630 not found, creating... [ 930.186339] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.186499] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.186616] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.186837] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.186977] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.187269] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.187427] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.187538] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.187741] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.187873] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.188024] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Resource: SegmentPort with ID: de111b63-62f4-4477-b957-54eaa851b630 is going to be created. [ 930.209019] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.209289] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.209790] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.210609] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.210923] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.211180] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "port-de111b63-62f4-4477-b957-54eaa851b630" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.231295] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.231514] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.231514] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.231626] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.231717] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.231818] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea is going to be created. [ 930.260411] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.260636] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.260636] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.260849] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.261024] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.270113] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea in Status: UNINITIALIZED for 2s [ 930.327506] env[65471]: INFO networking_nsxv3.common.synchronization [req-226b8052-7353-4d99-9ec5-4cdc4a3169f4 req-dde1f956-3db3-42b1-8e7e-4f996d194210 tempest-ServerActionsTestOtherB-402089456 tempest-ServerActionsTestOtherB-402089456-project-member] Enqueued Resource ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 with Priority: HIGHEST for action security_group_members [ 930.328485] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 with Priority: HIGHEST for action security_group_members [ 930.328833] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-b71ce0e0-83fe-4f36-8617-e29f83b0be32 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.328962] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.329184] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.329414] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.329591] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.329733] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.329779] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.329914] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.329997] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.330109] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b71ce0e0-83fe-4f36-8617-e29f83b0be32',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.832737] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.832887] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.833000] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.833802] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.856428] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.857103] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.857103] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.857103] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.857287] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.857287] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.857342] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 is going to be updated. [ 930.888048] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.888048] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.888048] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.888048] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.888048] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.896650] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 in Status: IN_PROGRESS for 2s [ 930.984019] env[65471]: INFO networking_nsxv3.common.synchronization [req-039d548d-987d-4df5-a2bf-0cc14beda1af req-f0607ebe-61c2-44f8-a622-9d498d6dbe80 service nova] Enqueued Resource ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea with Priority: HIGHEST for action security_group_rules [ 930.984019] env[65471]: INFO networking_nsxv3.common.synchronization [req-039d548d-987d-4df5-a2bf-0cc14beda1af req-f0607ebe-61c2-44f8-a622-9d498d6dbe80 service nova] Enqueued Resource ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea with Priority: HIGHEST for action security_group_members [ 930.984019] env[65471]: INFO networking_nsxv3.common.synchronization [req-039d548d-987d-4df5-a2bf-0cc14beda1af req-f0607ebe-61c2-44f8-a622-9d498d6dbe80 service nova] Enqueued Resource ID: de111b63-62f4-4477-b957-54eaa851b630 with Priority: HIGHEST for action port [ 930.984019] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea with Priority: HIGHEST for action security_group_rules [ 930.984019] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea with Priority: HIGHEST for action security_group_members [ 930.984019] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de111b63-62f4-4477-b957-54eaa851b630 with Priority: HIGHEST for action port [ 930.985448] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-918bf7c8-0ca6-4052-a0a9-38a8db5664ea taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.985448] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.985550] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.985592] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.985753] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-de111b63-62f4-4477-b957-54eaa851b630 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.985863] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de111b63-62f4-4477-b957-54eaa851b630" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.985926] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de111b63-62f4-4477-b957-54eaa851b630" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.986145] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de111b63-62f4-4477-b957-54eaa851b630" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.986241] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de111b63-62f4-4477-b957-54eaa851b630',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.489744] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port de111b63-62f4-4477-b957-54eaa851b630 with status ACTIVE [ 931.489744] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.489744] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.489744] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.489744] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.489744] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.489744] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.489744] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.489744] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.489744] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.490407] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.490407] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.490407] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.490407] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.490407] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.490407] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.490407] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: de111b63-62f4-4477-b957-54eaa851b630 is going to be updated. [ 931.512789] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.512939] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.513095] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.513220] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.513355] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.513510] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de111b63-62f4-4477-b957-54eaa851b630" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.831886] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock network-699 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.832275] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "network-699" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.832418] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "network-699" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.832739] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "network-699" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.833018] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.833235] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.833367] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.833583] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.833724] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.833930] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 931.834058] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 931.834173] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 931.834279] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 931.834388] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 931.834492] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 931.834618] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 931.854034] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 931.854034] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 931.854034] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 931.854231] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "network-699" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.854416] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock port-b11760c0-7e66-49d8-8142-d204f5fcdc43 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.854584] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "port-b11760c0-7e66-49d8-8142-d204f5fcdc43" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.854711] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "port-b11760c0-7e66-49d8-8142-d204f5fcdc43" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.855101] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "port-b11760c0-7e66-49d8-8142-d204f5fcdc43" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.855238] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b11760c0-7e66-49d8-8142-d204f5fcdc43',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.284852] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea in Status: SUCCESS [ 932.285126] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.285370] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.285635] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.285869] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.286049] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.286122] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.286329] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.286436] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.286560] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.286715] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('918bf7c8-0ca6-4052-a0a9-38a8db5664ea',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.287682] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.287872] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.288138] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.288280] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.288380] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.288548] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.289198] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.289198] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('918bf7c8-0ca6-4052-a0a9-38a8db5664ea',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.357851] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.358120] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.358253] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.358583] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.358741] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.358906] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Segment Port b11760c0-7e66-49d8-8142-d204f5fcdc43 not found, creating... [ 932.359200] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.359364] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.359488] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.359731] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.359869] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.360203] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.360397] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.360482] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.361337] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.361485] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.361778] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Resource: SegmentPort with ID: b11760c0-7e66-49d8-8142-d204f5fcdc43 is going to be created. [ 932.385827] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.385827] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.385827] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.386218] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.386218] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.387028] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "port-b11760c0-7e66-49d8-8142-d204f5fcdc43" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.792057] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.792421] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.792466] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('918bf7c8-0ca6-4052-a0a9-38a8db5664ea',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.908949] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 in Status: SUCCESS [ 932.909171] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 deletion is rescheduled due to dependency. [ 932.909289] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.118056] env[65471]: INFO networking_nsxv3.common.synchronization [req-039d548d-987d-4df5-a2bf-0cc14beda1af req-133236c8-3af6-4731-8b35-977d5bda4fac service nova] Enqueued Resource ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea with Priority: HIGHEST for action security_group_rules [ 933.118056] env[65471]: INFO networking_nsxv3.common.synchronization [req-039d548d-987d-4df5-a2bf-0cc14beda1af req-133236c8-3af6-4731-8b35-977d5bda4fac service nova] Enqueued Resource ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea with Priority: HIGHEST for action security_group_members [ 933.118193] env[65471]: INFO networking_nsxv3.common.synchronization [req-039d548d-987d-4df5-a2bf-0cc14beda1af req-133236c8-3af6-4731-8b35-977d5bda4fac service nova] Enqueued Resource ID: b11760c0-7e66-49d8-8142-d204f5fcdc43 with Priority: HIGHEST for action port [ 933.119396] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea with Priority: HIGHEST for action security_group_rules [ 933.119396] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea with Priority: HIGHEST for action security_group_members [ 933.119396] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b11760c0-7e66-49d8-8142-d204f5fcdc43 with Priority: HIGHEST for action port [ 933.120577] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-918bf7c8-0ca6-4052-a0a9-38a8db5664ea taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.121394] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.121545] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.121545] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.121745] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-b11760c0-7e66-49d8-8142-d204f5fcdc43 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.121860] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b11760c0-7e66-49d8-8142-d204f5fcdc43" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.122072] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b11760c0-7e66-49d8-8142-d204f5fcdc43" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.122210] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b11760c0-7e66-49d8-8142-d204f5fcdc43" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.122333] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b11760c0-7e66-49d8-8142-d204f5fcdc43',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.225567] env[65471]: INFO networking_nsxv3.common.synchronization [None req-7f467c39-12f2-4ce0-9ea7-5d7cd7aade20 tempest-ServerActionsTestOtherA-1623203122 tempest-ServerActionsTestOtherA-1623203122-project-member] Enqueued Resource ID: 0c92cf42-7023-4aba-91c3-95f84d379c9f with Priority: HIGHEST for action security_group_rules [ 933.226664] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c92cf42-7023-4aba-91c3-95f84d379c9f with Priority: HIGHEST for action security_group_rules [ 933.226985] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c92cf42-7023-4aba-91c3-95f84d379c9f taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.228238] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c92cf42-7023-4aba-91c3-95f84d379c9f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.228507] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c92cf42-7023-4aba-91c3-95f84d379c9f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.228582] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c92cf42-7023-4aba-91c3-95f84d379c9f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.228666] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c92cf42-7023-4aba-91c3-95f84d379c9f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.295943] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('918bf7c8-0ca6-4052-a0a9-38a8db5664ea',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.327325] env[65471]: INFO networking_nsxv3.common.synchronization [None req-8df4fc95-03a5-4108-9ad3-7ebd3e29c0b0 tempest-ServerActionsTestOtherA-1623203122 tempest-ServerActionsTestOtherA-1623203122-project-member] Enqueued Resource ID: 0c92cf42-7023-4aba-91c3-95f84d379c9f with Priority: HIGHEST for action security_group_rules [ 933.327921] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c92cf42-7023-4aba-91c3-95f84d379c9f with Priority: HIGHEST for action security_group_rules [ 933.327921] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c92cf42-7023-4aba-91c3-95f84d379c9f taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.328124] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c92cf42-7023-4aba-91c3-95f84d379c9f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.626146] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b11760c0-7e66-49d8-8142-d204f5fcdc43 with status ACTIVE [ 933.626146] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.626146] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.626146] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.626146] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.626146] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.626146] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.626146] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.626146] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.626146] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.626146] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.626623] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.626623] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.626623] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.626623] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.626623] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.626765] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b11760c0-7e66-49d8-8142-d204f5fcdc43 is going to be updated. [ 933.665975] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.667474] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.667474] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.667474] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.667474] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.667474] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b11760c0-7e66-49d8-8142-d204f5fcdc43" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.755153] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.755367] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.755367] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.755579] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.755674] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.755771] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c92cf42-7023-4aba-91c3-95f84d379c9f already deleted. [ 933.755855] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c92cf42-7023-4aba-91c3-95f84d379c9f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.756248] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c92cf42-7023-4aba-91c3-95f84d379c9f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.756368] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c92cf42-7023-4aba-91c3-95f84d379c9f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.756408] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c92cf42-7023-4aba-91c3-95f84d379c9f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.798934] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.799343] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.799343] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.799539] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.799539] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.799539] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea is going to be updated. [ 933.854043] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.854043] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.854043] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.854043] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.854043] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.863785] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea in Status: IN_PROGRESS for 2s [ 934.281654] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.281830] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.281873] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.282418] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.282418] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.282589] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c92cf42-7023-4aba-91c3-95f84d379c9f already deleted. [ 934.282728] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c92cf42-7023-4aba-91c3-95f84d379c9f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.792598] env[65471]: INFO networking_nsxv3.common.synchronization [req-6f01aa05-3f04-40cb-ad0d-0acb6fcd770c req-5a294ca2-24d7-429a-a101-d7623cab5e15 tempest-ServersTestJSON-569130442 tempest-ServersTestJSON-569130442-project-member] Enqueued Resource ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 with Priority: HIGHEST for action security_group_members [ 934.793218] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 with Priority: HIGHEST for action security_group_members [ 934.793570] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-735019a1-4315-46a6-b3c7-ec71fdc6ef33 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.793747] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.793747] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.794095] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.794287] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.794454] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.794532] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.794715] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.794802] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.794898] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.832574] env[65471]: INFO networking_nsxv3.common.synchronization [req-791c9b85-da6c-4003-974d-5437c4fa40cb req-8e1fa155-e9fd-4d54-9fd3-6e2321e5692e tempest-ServerRescueTestJSON-1224779364 tempest-ServerRescueTestJSON-1224779364-project-member] Enqueued Resource ID: a70c8576-d6c6-406f-8ebf-d5fb66c56b95 with Priority: HIGHEST for action security_group_members [ 934.836021] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a70c8576-d6c6-406f-8ebf-d5fb66c56b95 with Priority: HIGHEST for action security_group_members [ 934.836021] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-a70c8576-d6c6-406f-8ebf-d5fb66c56b95 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.836021] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a70c8576-d6c6-406f-8ebf-d5fb66c56b95" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.836021] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a70c8576-d6c6-406f-8ebf-d5fb66c56b95" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.836021] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a70c8576-d6c6-406f-8ebf-d5fb66c56b95" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.836021] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.836021] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.836021] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.836021] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.836021] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.836021] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a70c8576-d6c6-406f-8ebf-d5fb66c56b95',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.285795] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock network-92 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.285995] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "network-92" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.286142] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "network-92" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.286538] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "network-92" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.286821] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.286983] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.289411] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.289699] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.289869] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.290152] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 935.290316] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 935.290388] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 935.290497] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 935.290604] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 935.290707] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 935.290842] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 935.298300] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.298447] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.298523] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.298732] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.299136] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.299368] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.299476] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.299542] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.299708] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.299788] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.299876] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 already deleted. [ 935.299989] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.313883] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 935.314084] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 935.314250] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 935.314439] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "network-92" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.314755] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock port-0f18d3ab-3c13-4a30-951c-cb20f40d6747 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.314932] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "port-0f18d3ab-3c13-4a30-951c-cb20f40d6747" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.315060] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "port-0f18d3ab-3c13-4a30-951c-cb20f40d6747" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.315543] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "port-0f18d3ab-3c13-4a30-951c-cb20f40d6747" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.315642] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f18d3ab-3c13-4a30-951c-cb20f40d6747',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.336529] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a70c8576-d6c6-406f-8ebf-d5fb66c56b95',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.818603] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.818889] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.819061] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.819486] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.819691] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.819880] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Segment Port 0f18d3ab-3c13-4a30-951c-cb20f40d6747 not found, creating... [ 935.820228] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.820416] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.820545] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.820866] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.820947] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.821270] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.821449] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.821577] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.821810] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.821952] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.822149] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Resource: SegmentPort with ID: 0f18d3ab-3c13-4a30-951c-cb20f40d6747 is going to be created. [ 935.839046] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a70c8576-d6c6-406f-8ebf-d5fb66c56b95',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.843367] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.843572] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.843695] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.843975] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.844239] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.844471] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "port-0f18d3ab-3c13-4a30-951c-cb20f40d6747" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.877387] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea in Status: SUCCESS [ 935.877387] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.877387] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.877387] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.877387] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.877387] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.877387] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.877387] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.877387] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.877387] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.877387] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.877387] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.877387] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.877387] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.879030] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.879030] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.879030] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.879030] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.879030] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.879030] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.879030] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('918bf7c8-0ca6-4052-a0a9-38a8db5664ea',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.880324] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.880767] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.881084] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.881328] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.881482] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.881746] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.881927] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.882137] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('918bf7c8-0ca6-4052-a0a9-38a8db5664ea',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.341659] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.341922] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.341922] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.342312] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.342459] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.342921] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a70c8576-d6c6-406f-8ebf-d5fb66c56b95 is going to be updated. [ 936.380424] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.381070] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.381200] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.381443] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.381626] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.384532] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 918bf7c8-0ca6-4052-a0a9-38a8db5664ea: rpc.has_security_group_logging(os_id): False [ 936.385395] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('918bf7c8-0ca6-4052-a0a9-38a8db5664ea',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.396131] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a70c8576-d6c6-406f-8ebf-d5fb66c56b95 in Status: IN_PROGRESS for 2s [ 936.413583] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.413845] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.413845] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.414163] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.414269] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.414559] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.414699] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.414763] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.414976] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.415113] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.415352] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.415484] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.415577] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.415784] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.415893] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.416148] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.416273] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.416359] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.416538] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.416628] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.416738] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea is going to be created. [ 936.487315] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.487537] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.487617] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.487841] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.488038] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.500951] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea in Status: IN_PROGRESS for 2s [ 936.594438] env[65471]: INFO networking_nsxv3.common.synchronization [req-6f01aa05-3f04-40cb-ad0d-0acb6fcd770c req-269ed84e-608a-46f1-9a42-c0daa3436e4d service nova] Enqueued Resource ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 with Priority: HIGHEST for action security_group_rules [ 936.594699] env[65471]: INFO networking_nsxv3.common.synchronization [req-6f01aa05-3f04-40cb-ad0d-0acb6fcd770c req-269ed84e-608a-46f1-9a42-c0daa3436e4d service nova] Enqueued Resource ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 with Priority: HIGHEST for action security_group_members [ 936.594879] env[65471]: INFO networking_nsxv3.common.synchronization [req-6f01aa05-3f04-40cb-ad0d-0acb6fcd770c req-269ed84e-608a-46f1-9a42-c0daa3436e4d service nova] Enqueued Resource ID: 0f18d3ab-3c13-4a30-951c-cb20f40d6747 with Priority: HIGHEST for action port [ 936.595458] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 with Priority: HIGHEST for action security_group_rules [ 936.595701] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 with Priority: HIGHEST for action security_group_members [ 936.595701] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f18d3ab-3c13-4a30-951c-cb20f40d6747 with Priority: HIGHEST for action port [ 936.596029] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-735019a1-4315-46a6-b3c7-ec71fdc6ef33 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.596165] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.596246] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.596579] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.596776] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.597821] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-735019a1-4315-46a6-b3c7-ec71fdc6ef33 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.598976] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.598976] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.598976] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.598976] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.598976] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.598976] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.598976] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.598976] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.599370] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.600277] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f18d3ab-3c13-4a30-951c-cb20f40d6747 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.600434] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f18d3ab-3c13-4a30-951c-cb20f40d6747" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.600551] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f18d3ab-3c13-4a30-951c-cb20f40d6747" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.601053] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f18d3ab-3c13-4a30-951c-cb20f40d6747" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.601053] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f18d3ab-3c13-4a30-951c-cb20f40d6747',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.888825] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('918bf7c8-0ca6-4052-a0a9-38a8db5664ea',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.895559] env[65471]: INFO networking_nsxv3.common.synchronization [req-ce69f5fe-2cd2-4763-a53e-0c45dbcb5158 req-c7b3217e-87dd-4a89-a33e-c2c38a47eb57 tempest-DeleteServersTestJSON-72429361 tempest-DeleteServersTestJSON-72429361-project-member] Enqueued Resource ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 with Priority: HIGHEST for action security_group_members [ 936.896135] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 with Priority: HIGHEST for action security_group_members [ 936.896428] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-c35d5123-3fe1-447f-aedc-8112e5faa2b6 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.896550] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.896626] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.897991] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.898642] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.898789] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.898863] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.899070] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.899161] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.899626] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c35d5123-3fe1-447f-aedc-8112e5faa2b6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.103354] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.104414] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-735019a1-4315-46a6-b3c7-ec71fdc6ef33 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.104566] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.107511] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0f18d3ab-3c13-4a30-951c-cb20f40d6747 with status ACTIVE [ 937.107511] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.107511] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.107511] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.107511] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.107511] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.107511] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.107511] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.107511] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.107511] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.107511] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.107511] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.107511] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.107511] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.107511] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.107511] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.107511] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0f18d3ab-3c13-4a30-951c-cb20f40d6747 is going to be updated. [ 937.128536] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.128707] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.128767] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.128961] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.129268] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.129268] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f18d3ab-3c13-4a30-951c-cb20f40d6747" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.392023] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.392242] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.392316] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.392532] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.392621] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.392723] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea is going to be updated. [ 937.402123] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.402383] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.402454] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.402764] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.402875] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.403162] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.403289] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.403376] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.403628] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.403726] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.403824] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 is going to be updated. [ 937.448214] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.448359] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.448879] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.449181] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.449338] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.452446] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.452614] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.452723] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.452946] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.453128] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.458109] env[65471]: INFO networking_nsxv3.common.synchronization [req-e7b13138-c7fa-4935-8f74-95ae4fe1ddf2 req-8015aecc-3de2-4319-bff6-5198f6e5f397 tempest-ImagesTestJSON-650286870 tempest-ImagesTestJSON-650286870-project-member] Enqueued Resource ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f with Priority: HIGHEST for action security_group_members [ 937.458659] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f with Priority: HIGHEST for action security_group_members [ 937.458969] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-85af6c5e-2f9b-491d-9584-96c44b20f99f taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.459102] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.459171] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.459366] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.459746] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.459746] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.459746] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.459921] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.459921] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.459986] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85af6c5e-2f9b-491d-9584-96c44b20f99f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.465981] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea in Status: IN_PROGRESS for 2s [ 937.466185] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 in Status: IN_PROGRESS for 2s [ 937.606719] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.824598] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock network-235 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.825182] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "network-235" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.825182] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "network-235" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.825310] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "network-235" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.825488] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.825645] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.825762] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.825974] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.826270] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.826485] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 937.826598] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 937.826707] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 937.826816] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 937.826924] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 937.827040] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 937.827178] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 937.848824] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 937.848984] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 937.849137] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 937.849319] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "network-235" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.849644] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock port-7d10ab50-a71b-490b-b9e9-964705daceac taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.849848] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "port-7d10ab50-a71b-490b-b9e9-964705daceac" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.849980] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "port-7d10ab50-a71b-490b-b9e9-964705daceac" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.850336] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "port-7d10ab50-a71b-490b-b9e9-964705daceac" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.850478] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d10ab50-a71b-490b-b9e9-964705daceac',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.964831] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('85af6c5e-2f9b-491d-9584-96c44b20f99f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.055563] env[65471]: INFO networking_nsxv3.common.synchronization [req-3112cc56-a5d9-4f5e-ba0a-e4a723f173e6 req-7ecdf566-dabf-40df-818d-6bdad380bdf2 tempest-MigrationsAdminTest-433965692 tempest-MigrationsAdminTest-433965692-project-member] Enqueued Resource ID: 2ecf6012-bc6c-4512-8d9d-962c10f0cad9 with Priority: HIGHEST for action security_group_members [ 938.056111] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ecf6012-bc6c-4512-8d9d-962c10f0cad9 with Priority: HIGHEST for action security_group_members [ 938.056423] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.056530] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.056633] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.056818] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.057093] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.057203] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.057262] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.057423] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.057506] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.057602] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ecf6012-bc6c-4512-8d9d-962c10f0cad9',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.108659] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.108856] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.108930] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.109119] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.109305] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.109413] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 is going to be created. [ 938.133017] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.133230] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.133230] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.133456] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.133595] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.143696] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 in Status: UNINITIALIZED for 2s [ 938.353869] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.354162] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.354310] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.354655] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.354812] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.354969] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Segment Port 7d10ab50-a71b-490b-b9e9-964705daceac not found, creating... [ 938.355255] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.355413] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.355528] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.355747] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.355883] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.356175] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.356329] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.356444] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.356871] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.356871] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.357015] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Resource: SegmentPort with ID: 7d10ab50-a71b-490b-b9e9-964705daceac is going to be created. [ 938.414389] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a70c8576-d6c6-406f-8ebf-d5fb66c56b95 in Status: SUCCESS [ 938.414683] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a70c8576-d6c6-406f-8ebf-d5fb66c56b95" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.422101] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.422433] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.422574] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.422865] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.423196] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.423465] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "port-7d10ab50-a71b-490b-b9e9-964705daceac" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.466600] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('85af6c5e-2f9b-491d-9584-96c44b20f99f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.516032] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea in Status: SUCCESS [ 938.516032] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.516231] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.516351] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.516440] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('918bf7c8-0ca6-4052-a0a9-38a8db5664ea',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.561043] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2ecf6012-bc6c-4512-8d9d-962c10f0cad9',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.969188] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.969550] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.969550] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.969916] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.969916] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.970093] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f is going to be updated. [ 939.002805] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.003031] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.003031] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.003341] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.003525] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.013115] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f in Status: IN_PROGRESS for 2s [ 939.018622] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.018749] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.062765] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2ecf6012-bc6c-4512-8d9d-962c10f0cad9',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.089601] env[65471]: INFO networking_nsxv3.common.synchronization [req-e7b13138-c7fa-4935-8f74-95ae4fe1ddf2 req-2b6775f9-a51e-4e4a-9024-5950f4801091 service nova] Enqueued Resource ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f with Priority: HIGHEST for action security_group_rules [ 939.089601] env[65471]: INFO networking_nsxv3.common.synchronization [req-e7b13138-c7fa-4935-8f74-95ae4fe1ddf2 req-2b6775f9-a51e-4e4a-9024-5950f4801091 service nova] Enqueued Resource ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f with Priority: HIGHEST for action security_group_members [ 939.089601] env[65471]: INFO networking_nsxv3.common.synchronization [req-e7b13138-c7fa-4935-8f74-95ae4fe1ddf2 req-2b6775f9-a51e-4e4a-9024-5950f4801091 service nova] Enqueued Resource ID: 7d10ab50-a71b-490b-b9e9-964705daceac with Priority: HIGHEST for action port [ 939.089601] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f with Priority: HIGHEST for action security_group_rules [ 939.089811] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f with Priority: HIGHEST for action security_group_members [ 939.089811] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d10ab50-a71b-490b-b9e9-964705daceac with Priority: HIGHEST for action port [ 939.093370] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85af6c5e-2f9b-491d-9584-96c44b20f99f taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.093464] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.093464] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.093728] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.093799] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85af6c5e-2f9b-491d-9584-96c44b20f99f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.095879] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-85af6c5e-2f9b-491d-9584-96c44b20f99f taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.096055] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.096269] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-7d10ab50-a71b-490b-b9e9-964705daceac taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.097077] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7d10ab50-a71b-490b-b9e9-964705daceac" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.097077] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7d10ab50-a71b-490b-b9e9-964705daceac" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.097077] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7d10ab50-a71b-490b-b9e9-964705daceac" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.097077] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d10ab50-a71b-490b-b9e9-964705daceac',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.480817] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea in Status: SUCCESS [ 939.481130] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.481938] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 in Status: SUCCESS [ 939.482281] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 deletion is rescheduled due to dependency. [ 939.482281] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.482415] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.482651] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.482847] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.482959] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.483780] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.484156] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.484253] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.484505] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.484567] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('918bf7c8-0ca6-4052-a0a9-38a8db5664ea',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.570259] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.570259] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.570259] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.570259] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.570259] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.570259] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ecf6012-bc6c-4512-8d9d-962c10f0cad9 is going to be updated. [ 939.599650] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.599650] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.599650] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.599650] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.599650] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.599650] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7d10ab50-a71b-490b-b9e9-964705daceac with status ACTIVE [ 939.599650] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.600694] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.601205] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.603031] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.603031] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.603031] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.603031] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.603031] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.603031] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.603031] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.603031] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.603031] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.603031] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.603031] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.603031] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.603031] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7d10ab50-a71b-490b-b9e9-964705daceac is going to be updated. [ 939.605761] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-85af6c5e-2f9b-491d-9584-96c44b20f99f taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.605761] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.613652] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ecf6012-bc6c-4512-8d9d-962c10f0cad9 in Status: IN_PROGRESS for 2s [ 939.624531] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.624531] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.624825] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.624825] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.625155] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.625155] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7d10ab50-a71b-490b-b9e9-964705daceac" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.970103] env[65471]: INFO networking_nsxv3.common.synchronization [req-79d7377c-f2da-4975-bf4e-34f84fed784c req-e16a07b1-ba74-4671-b986-0e7eeb4811bb tempest-ImagesOneServerNegativeTestJSON-124059679 tempest-ImagesOneServerNegativeTestJSON-124059679-project-member] Enqueued Resource ID: a3c5f688-9271-4722-84e9-69667c674933 with Priority: HIGHEST for action security_group_members [ 939.970689] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3c5f688-9271-4722-84e9-69667c674933 with Priority: HIGHEST for action security_group_members [ 939.970988] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3c5f688-9271-4722-84e9-69667c674933 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.971468] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.971703] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.971755] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.971896] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.971995] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.972138] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.972321] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.972408] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.972497] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a3c5f688-9271-4722-84e9-69667c674933',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.990662] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.990662] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.990662] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.990662] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.990662] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.990662] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.990662] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.990662] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.990662] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.991079] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.991079] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.991079] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.991079] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.991202] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.991312] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.991396] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.991453] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.991577] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.991647] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.991722] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.991809] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('918bf7c8-0ca6-4052-a0a9-38a8db5664ea',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.158133] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 in Status: SUCCESS [ 940.158133] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.158618] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.161963] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.161963] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.161963] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.161963] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.161963] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.161963] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.161963] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.161963] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.387141] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock network-16 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.388119] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "network-16" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.388119] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "network-16" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.388119] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "network-16" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.388363] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.388541] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.388660] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.388911] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.389145] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.389275] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 940.389390] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 940.389497] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 940.389604] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 940.389710] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 940.389822] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 940.389946] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 940.410380] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 940.410380] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 940.410639] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 940.410694] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "network-16" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.411226] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock port-123f6778-9b91-4571-8b80-945abacb4a32 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.411420] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "port-123f6778-9b91-4571-8b80-945abacb4a32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.411510] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "port-123f6778-9b91-4571-8b80-945abacb4a32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.411781] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "port-123f6778-9b91-4571-8b80-945abacb4a32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.411918] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('123f6778-9b91-4571-8b80-945abacb4a32',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.475023] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.475023] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.475023] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.475227] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.475309] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.475504] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.475592] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.475657] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.475800] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.475874] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.475959] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3c5f688-9271-4722-84e9-69667c674933 is going to be updated. [ 940.497645] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 918bf7c8-0ca6-4052-a0a9-38a8db5664ea: rpc.has_security_group_logging(os_id): False [ 940.505917] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.506253] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.506253] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.506463] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.506592] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.522022] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3c5f688-9271-4722-84e9-69667c674933 in Status: IN_PROGRESS for 2s [ 940.522022] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.522022] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.522022] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.522022] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.522022] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.522022] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.522022] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.522022] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.522022] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.522022] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.522022] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.522022] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.522022] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.522022] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.522605] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.522605] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.522605] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.522605] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.522605] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.522605] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.522605] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea is going to be updated. [ 940.584699] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.584699] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.584699] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.584889] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.585946] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.597936] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea in Status: IN_PROGRESS for 2s [ 940.664566] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-735019a1-4315-46a6-b3c7-ec71fdc6ef33 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.664733] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.664807] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.665043] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.665215] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.665316] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.665380] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.665522] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.665611] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.665697] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.665842] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-735019a1-4315-46a6-b3c7-ec71fdc6ef33 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.665933] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.665996] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.666151] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.666289] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.666376] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.666458] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.666613] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.666695] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.666765] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.666863] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.915916] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.915916] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.915916] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.915916] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.915916] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.915916] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Segment Port 123f6778-9b91-4571-8b80-945abacb4a32 not found, creating... [ 940.915916] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.916251] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.916251] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.917029] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.917029] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.917029] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.917029] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.917276] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.917404] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.917483] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.917656] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Resource: SegmentPort with ID: 123f6778-9b91-4571-8b80-945abacb4a32 is going to be created. [ 940.939856] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.940165] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.940312] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.940585] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.940815] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.941052] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "port-123f6778-9b91-4571-8b80-945abacb4a32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.037705] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f in Status: SUCCESS [ 941.038154] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.038154] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.038361] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.038685] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.038861] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.038861] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.039043] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.039126] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.039215] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85af6c5e-2f9b-491d-9584-96c44b20f99f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.168918] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 735019a1-4315-46a6-b3c7-ec71fdc6ef33: rpc.has_security_group_logging(os_id): False [ 941.196892] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.196892] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.196892] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.197130] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.197185] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.197383] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.197467] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.197530] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.197677] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.197750] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.197938] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.198046] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.198109] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.198247] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.198320] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.198525] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.198618] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.198681] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.198817] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.198889] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.198972] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 is going to be created. [ 941.296111] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.296306] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.296402] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.296646] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.296850] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.316886] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 in Status: IN_PROGRESS for 2s [ 941.543079] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('85af6c5e-2f9b-491d-9584-96c44b20f99f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.625181] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ecf6012-bc6c-4512-8d9d-962c10f0cad9 in Status: SUCCESS [ 941.625324] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.716320] env[65471]: INFO networking_nsxv3.common.synchronization [req-79d7377c-f2da-4975-bf4e-34f84fed784c req-11fd6804-17f3-4fcc-80a5-75823fe44720 service nova] Enqueued Resource ID: a3c5f688-9271-4722-84e9-69667c674933 with Priority: HIGHEST for action security_group_rules [ 941.716615] env[65471]: INFO networking_nsxv3.common.synchronization [req-79d7377c-f2da-4975-bf4e-34f84fed784c req-11fd6804-17f3-4fcc-80a5-75823fe44720 service nova] Enqueued Resource ID: a3c5f688-9271-4722-84e9-69667c674933 with Priority: HIGHEST for action security_group_members [ 941.716744] env[65471]: INFO networking_nsxv3.common.synchronization [req-79d7377c-f2da-4975-bf4e-34f84fed784c req-11fd6804-17f3-4fcc-80a5-75823fe44720 service nova] Enqueued Resource ID: 123f6778-9b91-4571-8b80-945abacb4a32 with Priority: HIGHEST for action port [ 941.717281] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3c5f688-9271-4722-84e9-69667c674933 with Priority: HIGHEST for action security_group_rules [ 941.717693] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3c5f688-9271-4722-84e9-69667c674933 with Priority: HIGHEST for action security_group_members [ 941.717812] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 123f6778-9b91-4571-8b80-945abacb4a32 with Priority: HIGHEST for action port [ 941.718355] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a3c5f688-9271-4722-84e9-69667c674933 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.718355] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.718355] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.718637] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.718778] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a3c5f688-9271-4722-84e9-69667c674933',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.719619] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3c5f688-9271-4722-84e9-69667c674933 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.719718] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.719914] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-123f6778-9b91-4571-8b80-945abacb4a32 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.720127] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-123f6778-9b91-4571-8b80-945abacb4a32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.720127] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-123f6778-9b91-4571-8b80-945abacb4a32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.720273] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-123f6778-9b91-4571-8b80-945abacb4a32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.720347] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('123f6778-9b91-4571-8b80-945abacb4a32',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.047131] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('85af6c5e-2f9b-491d-9584-96c44b20f99f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.221677] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3c5f688-9271-4722-84e9-69667c674933 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.221923] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.222200] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 123f6778-9b91-4571-8b80-945abacb4a32 with status ACTIVE [ 942.222386] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.222499] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.222566] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.222764] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.222854] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.223057] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.223190] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.223254] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.223410] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.223492] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.223674] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.223766] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.223827] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.223966] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.224055] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.224141] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 123f6778-9b91-4571-8b80-945abacb4a32 is going to be updated. [ 942.268389] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.268389] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.268389] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.268389] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.268564] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.268669] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-123f6778-9b91-4571-8b80-945abacb4a32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.530169] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3c5f688-9271-4722-84e9-69667c674933 in Status: SUCCESS [ 942.530442] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3c5f688-9271-4722-84e9-69667c674933 deletion is rescheduled due to dependency. [ 942.530561] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.531045] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.531045] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.531219] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.531278] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.531508] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.531508] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.531613] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.534035] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a3c5f688-9271-4722-84e9-69667c674933',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.551885] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.552184] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.552323] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.552555] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.552746] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.552746] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f is going to be updated. [ 942.587284] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.587474] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.587474] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.588885] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.588885] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.613319] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f in Status: IN_PROGRESS for 2s [ 942.623621] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea in Status: SUCCESS [ 942.623887] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.624102] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.624423] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.624555] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('918bf7c8-0ca6-4052-a0a9-38a8db5664ea',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.033797] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a3c5f688-9271-4722-84e9-69667c674933',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.128589] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.128589] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.128589] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.128589] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.128589] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.128589] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.128589] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.128589] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.128589] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.130683] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.130683] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('918bf7c8-0ca6-4052-a0a9-38a8db5664ea',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.338041] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 in Status: SUCCESS [ 943.338041] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.536269] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a3c5f688-9271-4722-84e9-69667c674933',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.637825] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.637990] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.638078] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.638296] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.641415] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.641415] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.641415] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.641415] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.641415] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.641415] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.641415] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.641415] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.641415] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.641415] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.641415] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.641415] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.641415] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.641415] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.641415] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.641415] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.641415] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('918bf7c8-0ca6-4052-a0a9-38a8db5664ea',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.671202] env[65471]: INFO networking_nsxv3.common.synchronization [None req-ac5f54af-1e32-49aa-8eb3-330a83d40247 None None] Enqueued Resource ID: 68f2ea8d-af92-4859-af28-6938b78e8d1b with Priority: HIGHEST for action port [ 943.671202] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68f2ea8d-af92-4859-af28-6938b78e8d1b with Priority: HIGHEST for action port [ 943.671490] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-68f2ea8d-af92-4859-af28-6938b78e8d1b taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.671611] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-68f2ea8d-af92-4859-af28-6938b78e8d1b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.671676] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-68f2ea8d-af92-4859-af28-6938b78e8d1b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.671973] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-68f2ea8d-af92-4859-af28-6938b78e8d1b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.672057] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68f2ea8d-af92-4859-af28-6938b78e8d1b',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.041617] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.041783] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.041912] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.042134] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.042255] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.042384] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3c5f688-9271-4722-84e9-69667c674933 is going to be updated. [ 944.077928] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.078157] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.078157] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.078350] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.078522] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.093280] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3c5f688-9271-4722-84e9-69667c674933 in Status: IN_PROGRESS for 2s [ 944.148487] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 918bf7c8-0ca6-4052-a0a9-38a8db5664ea: rpc.has_security_group_logging(os_id): False [ 944.168432] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.168681] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.168837] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.169210] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.169602] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.170085] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.170085] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.170085] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.170350] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.170496] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.170843] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.171509] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.171509] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.171509] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.171509] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.171844] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.172023] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.172152] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.172385] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.172520] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.172663] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea is going to be updated. [ 944.174503] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 68f2ea8d-af92-4859-af28-6938b78e8d1b [ 944.175199] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.175199] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.175199] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.175371] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.175406] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.175544] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:68f2ea8d-af92-4859-af28-6938b78e8d1b already deleted. [ 944.175677] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-68f2ea8d-af92-4859-af28-6938b78e8d1b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.244524] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.244690] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.244845] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.245012] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.245541] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.262150] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea in Status: IN_PROGRESS for 2s [ 944.570927] env[65471]: INFO networking_nsxv3.common.synchronization [req-07d2109f-acd1-4d6b-9e1a-dad62f465423 req-92faa72a-8c04-4a1d-aa3e-72411a42a2b2 tempest-ServersTestMultiNic-44021310 tempest-ServersTestMultiNic-44021310-project-member] Enqueued Resource ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea with Priority: HIGHEST for action security_group_members [ 944.571586] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea with Priority: HIGHEST for action security_group_members [ 944.571901] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.572036] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.572163] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.572576] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.572576] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.572681] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.572729] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.572876] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.572960] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.573075] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('918bf7c8-0ca6-4052-a0a9-38a8db5664ea',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.627785] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f in Status: SUCCESS [ 944.627785] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.627785] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.628022] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.628591] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.628591] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.628591] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.628895] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.628895] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.628895] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.628989] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('85af6c5e-2f9b-491d-9584-96c44b20f99f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.075607] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('918bf7c8-0ca6-4052-a0a9-38a8db5664ea',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.133536] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-85af6c5e-2f9b-491d-9584-96c44b20f99f taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.133840] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.133840] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.134121] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.134326] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.134449] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.134449] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.134619] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.134746] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.134809] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.134968] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-85af6c5e-2f9b-491d-9584-96c44b20f99f taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.135108] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.135162] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.135306] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.135487] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.135588] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.135707] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.135826] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.135903] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.136021] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.140599] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('85af6c5e-2f9b-491d-9584-96c44b20f99f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.153300] env[65471]: INFO networking_nsxv3.common.synchronization [req-07d2109f-acd1-4d6b-9e1a-dad62f465423 req-c46cdf23-eb36-4b09-9c8c-b90d39c78743 tempest-ServersTestMultiNic-44021310 tempest-ServersTestMultiNic-44021310-project-member] Enqueued Resource ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea with Priority: HIGHEST for action security_group_members [ 945.153300] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea with Priority: HIGHEST for action security_group_members [ 945.153300] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.153300] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.579906] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('918bf7c8-0ca6-4052-a0a9-38a8db5664ea',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.642130] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 85af6c5e-2f9b-491d-9584-96c44b20f99f: rpc.has_security_group_logging(os_id): False [ 945.666434] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.666603] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.666669] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.667386] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.667386] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.667619] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.667776] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.669298] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.669529] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.669622] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.669887] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.670102] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.670256] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.670388] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.670473] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.670678] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.670780] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.670834] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.670972] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.671059] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.671151] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f is going to be updated. [ 945.741826] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.742450] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.742450] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.744302] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.744481] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.768325] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f in Status: IN_PROGRESS for 2s [ 945.777271] env[65471]: INFO networking_nsxv3.common.synchronization [req-07d2109f-acd1-4d6b-9e1a-dad62f465423 req-419e5e4e-05de-453a-974d-711260d212b0 tempest-ServersTestMultiNic-44021310 tempest-ServersTestMultiNic-44021310-project-member] Enqueued Resource ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea with Priority: HIGHEST for action security_group_members [ 945.778770] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea with Priority: HIGHEST for action security_group_members [ 945.779437] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.779709] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.083760] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.083985] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.084102] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.084437] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.084574] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.084746] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea is going to be updated. [ 946.107457] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3c5f688-9271-4722-84e9-69667c674933 in Status: SUCCESS [ 946.109998] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.109998] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.109998] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.109998] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.109998] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.109998] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.109998] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.109998] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.109998] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.109998] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a3c5f688-9271-4722-84e9-69667c674933',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.148670] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.148670] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.148670] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.148670] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.148670] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.164953] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea in Status: IN_PROGRESS for 2s [ 946.283782] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea in Status: SUCCESS [ 946.284755] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.421341] env[65471]: INFO networking_nsxv3.common.synchronization [None req-7a18f543-f3f4-4f08-8201-1995eaaa04e2 None None] Enqueued Resource ID: a508e9f5-8fb4-4a13-a469-d7c823a0cb4e with Priority: HIGHEST for action port [ 946.421341] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a508e9f5-8fb4-4a13-a469-d7c823a0cb4e with Priority: HIGHEST for action port [ 946.422122] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-a508e9f5-8fb4-4a13-a469-d7c823a0cb4e taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.422122] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a508e9f5-8fb4-4a13-a469-d7c823a0cb4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.422122] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a508e9f5-8fb4-4a13-a469-d7c823a0cb4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.422303] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a508e9f5-8fb4-4a13-a469-d7c823a0cb4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.422371] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a508e9f5-8fb4-4a13-a469-d7c823a0cb4e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.612083] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3c5f688-9271-4722-84e9-69667c674933 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.612392] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.612482] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.612660] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.612953] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.613318] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.613400] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.613726] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.613854] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.613962] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.614153] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3c5f688-9271-4722-84e9-69667c674933 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.614259] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.614344] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.614519] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.614675] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.614778] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.614847] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.615025] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.615107] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.615203] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.615305] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a3c5f688-9271-4722-84e9-69667c674933',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.845126] env[65471]: INFO networking_nsxv3.common.synchronization [req-4357666d-bc48-41e0-97c3-acaec25a9749 req-4e6dd11e-f838-49df-913b-df9186ebb450 tempest-ListServerFiltersTestJSON-1343098391 tempest-ListServerFiltersTestJSON-1343098391-project-member] Enqueued Resource ID: 7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 with Priority: HIGHEST for action security_group_members [ 946.845196] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 with Priority: HIGHEST for action security_group_members [ 946.846247] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.846247] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.846247] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.846247] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.846669] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.846669] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.846901] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.847135] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.847252] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.847750] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b0e439e-ae4b-45e5-b678-0ea9b193c6d4',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.924600] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a508e9f5-8fb4-4a13-a469-d7c823a0cb4e [ 946.924867] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.925675] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.925675] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.925675] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.925675] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.925675] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a508e9f5-8fb4-4a13-a469-d7c823a0cb4e already deleted. [ 946.925675] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a508e9f5-8fb4-4a13-a469-d7c823a0cb4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.118830] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a3c5f688-9271-4722-84e9-69667c674933: rpc.has_security_group_logging(os_id): False [ 947.141760] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.142062] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.142176] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.142504] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.142669] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.143034] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.143722] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.143722] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.144300] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.144397] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.144705] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.144705] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.144808] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.145543] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.145543] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.145543] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.145543] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.145543] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.145543] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.145543] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.145987] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a3c5f688-9271-4722-84e9-69667c674933 is going to be updated. [ 947.222712] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.223417] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.223417] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.223417] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.223417] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.238761] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a3c5f688-9271-4722-84e9-69667c674933 in Status: IN_PROGRESS for 2s [ 947.352609] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.352961] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.353080] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.353469] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.353583] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.353806] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.353910] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.353975] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.354162] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.354338] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.354487] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 already deleted. [ 947.354578] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.360302] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock network-201 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.360484] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "network-201" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.360610] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "network-201" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.360958] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "network-201" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.361257] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.361580] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.361580] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.361858] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.361923] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.362242] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 947.362298] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 947.362410] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 947.362520] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 947.362667] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 947.362749] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 947.362881] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 947.389368] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 947.389368] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 947.389368] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 947.389368] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "network-201" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.389570] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock port-b0847c73-0477-4d7a-b90d-adc3d98e73e2 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.389647] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "port-b0847c73-0477-4d7a-b90d-adc3d98e73e2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.390295] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "port-b0847c73-0477-4d7a-b90d-adc3d98e73e2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.390295] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "port-b0847c73-0477-4d7a-b90d-adc3d98e73e2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.390295] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0847c73-0477-4d7a-b90d-adc3d98e73e2',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.665920] env[65471]: INFO networking_nsxv3.common.synchronization [req-dbc45bf8-0e93-4b21-a78e-4ca277b19a4a req-a339100c-d680-40b5-b879-9f3db7d22fb9 tempest-SecurityGroupRulesTestJSON-897669021 tempest-SecurityGroupRulesTestJSON-897669021-project-member] Enqueued Resource ID: 038310e4-3aff-4c9b-b2f0-015a1e727dab with Priority: HIGHEST for action security_group_rules [ 947.667480] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 038310e4-3aff-4c9b-b2f0-015a1e727dab with Priority: HIGHEST for action security_group_rules [ 947.667480] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-038310e4-3aff-4c9b-b2f0-015a1e727dab taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.667480] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-038310e4-3aff-4c9b-b2f0-015a1e727dab" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.667480] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-038310e4-3aff-4c9b-b2f0-015a1e727dab" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.668077] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-038310e4-3aff-4c9b-b2f0-015a1e727dab" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.668077] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('038310e4-3aff-4c9b-b2f0-015a1e727dab',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.786452] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f in Status: SUCCESS [ 947.786676] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.892961] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.893337] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.893506] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.893857] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.894118] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.894174] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Segment Port b0847c73-0477-4d7a-b90d-adc3d98e73e2 not found, creating... [ 947.894450] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.894618] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.894734] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.894960] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.895121] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.895401] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.895903] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.896081] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.896360] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.896665] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.896930] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Resource: SegmentPort with ID: b0847c73-0477-4d7a-b90d-adc3d98e73e2 is going to be created. [ 947.920747] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.921068] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.921213] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.921499] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.921730] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.921959] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "port-b0847c73-0477-4d7a-b90d-adc3d98e73e2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.175828] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea in Status: SUCCESS [ 948.176017] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.176231] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.176477] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.176682] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.176815] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.176890] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.177086] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.177184] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.177303] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('918bf7c8-0ca6-4052-a0a9-38a8db5664ea',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.188073] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.188222] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.188307] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.188476] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.188562] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.188663] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 038310e4-3aff-4c9b-b2f0-015a1e727dab already deleted. [ 948.188748] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-038310e4-3aff-4c9b-b2f0-015a1e727dab" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.650900] env[65471]: INFO networking_nsxv3.common.synchronization [req-4357666d-bc48-41e0-97c3-acaec25a9749 req-12947cdf-9043-4252-9d28-0978448692e5 service nova] Enqueued Resource ID: 7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 with Priority: HIGHEST for action security_group_rules [ 948.651189] env[65471]: INFO networking_nsxv3.common.synchronization [req-4357666d-bc48-41e0-97c3-acaec25a9749 req-12947cdf-9043-4252-9d28-0978448692e5 service nova] Enqueued Resource ID: 7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 with Priority: HIGHEST for action security_group_members [ 948.651189] env[65471]: INFO networking_nsxv3.common.synchronization [req-4357666d-bc48-41e0-97c3-acaec25a9749 req-12947cdf-9043-4252-9d28-0978448692e5 service nova] Enqueued Resource ID: b0847c73-0477-4d7a-b90d-adc3d98e73e2 with Priority: HIGHEST for action port [ 948.651707] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 with Priority: HIGHEST for action security_group_rules [ 948.652040] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 with Priority: HIGHEST for action security_group_members [ 948.652164] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0847c73-0477-4d7a-b90d-adc3d98e73e2 with Priority: HIGHEST for action port [ 948.652464] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.652584] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.652647] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.652898] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.652976] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7b0e439e-ae4b-45e5-b678-0ea9b193c6d4',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.654143] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.654282] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.654364] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.654583] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.654658] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.654732] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.654799] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.654909] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.655064] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.655160] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b0e439e-ae4b-45e5-b678-0ea9b193c6d4',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.656815] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-b0847c73-0477-4d7a-b90d-adc3d98e73e2 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.656815] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b0847c73-0477-4d7a-b90d-adc3d98e73e2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.656815] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b0847c73-0477-4d7a-b90d-adc3d98e73e2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.656815] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b0847c73-0477-4d7a-b90d-adc3d98e73e2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.656815] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0847c73-0477-4d7a-b90d-adc3d98e73e2',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.681510] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.681664] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.681845] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.681944] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.682360] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.682360] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.682523] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.682523] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.682639] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.682715] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.682802] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea is going to be updated. [ 948.716251] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.716423] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.716509] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.717057] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.717057] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.726489] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea in Status: IN_PROGRESS for 2s [ 949.158696] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7b0e439e-ae4b-45e5-b678-0ea9b193c6d4',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.160919] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.161356] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.169940] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b0847c73-0477-4d7a-b90d-adc3d98e73e2 with status ACTIVE [ 949.169940] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.169940] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.169940] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.169940] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.169940] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.169940] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.169940] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.169940] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.169940] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.169940] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.169940] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.169940] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.169940] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.169940] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.169940] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.169940] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b0847c73-0477-4d7a-b90d-adc3d98e73e2 is going to be updated. [ 949.209184] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.209398] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.209451] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.209826] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.209950] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.210081] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b0847c73-0477-4d7a-b90d-adc3d98e73e2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.259508] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a3c5f688-9271-4722-84e9-69667c674933 in Status: SUCCESS [ 949.259754] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.669519] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7b0e439e-ae4b-45e5-b678-0ea9b193c6d4',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.172437] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.172802] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.172802] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.173257] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.173370] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.173615] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 is going to be created. [ 950.203319] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.203319] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.203319] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.203319] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.203319] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.218320] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 in Status: UNINITIALIZED for 2s [ 950.388602] env[65471]: INFO networking_nsxv3.common.synchronization [None req-e009be77-b9d7-41a3-aff1-5065bf3c8693 None None] Enqueued Resource ID: e1c64a1a-8b52-4fcf-87fd-d0822af3be71 with Priority: HIGHEST for action port [ 950.389253] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1c64a1a-8b52-4fcf-87fd-d0822af3be71 with Priority: HIGHEST for action port [ 950.389639] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-e1c64a1a-8b52-4fcf-87fd-d0822af3be71 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.389773] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e1c64a1a-8b52-4fcf-87fd-d0822af3be71" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.389851] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e1c64a1a-8b52-4fcf-87fd-d0822af3be71" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.390284] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e1c64a1a-8b52-4fcf-87fd-d0822af3be71" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.390505] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e1c64a1a-8b52-4fcf-87fd-d0822af3be71',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.612452] env[65471]: INFO networking_nsxv3.common.synchronization [None req-350f5599-a230-473b-a4e7-08a32354f67d None None] Enqueued Resource ID: 342236f2-0599-467d-9a3f-60c3778214c2 with Priority: HIGHEST for action port [ 950.612711] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 342236f2-0599-467d-9a3f-60c3778214c2 with Priority: HIGHEST for action port [ 950.613736] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-342236f2-0599-467d-9a3f-60c3778214c2 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.615034] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-342236f2-0599-467d-9a3f-60c3778214c2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.615034] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-342236f2-0599-467d-9a3f-60c3778214c2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.615034] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-342236f2-0599-467d-9a3f-60c3778214c2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.615034] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('342236f2-0599-467d-9a3f-60c3778214c2',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.739532] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea in Status: SUCCESS [ 950.739532] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea deletion is rescheduled due to dependency. [ 950.739868] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.739868] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.741154] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.741154] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.741154] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.741154] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.741154] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.741154] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.741154] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('918bf7c8-0ca6-4052-a0a9-38a8db5664ea',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.894022] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e1c64a1a-8b52-4fcf-87fd-d0822af3be71 [ 950.894022] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.894022] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.894022] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.894022] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.894338] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.894338] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e1c64a1a-8b52-4fcf-87fd-d0822af3be71 already deleted. [ 950.894338] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e1c64a1a-8b52-4fcf-87fd-d0822af3be71" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.988917] env[65471]: INFO networking_nsxv3.common.synchronization [req-7922a330-13c2-4f5e-be47-b2cc339fea18 req-fa7a5ac4-6ca1-4c82-983b-464286f3bf8f tempest-ListServerFiltersTestJSON-1343098391 tempest-ListServerFiltersTestJSON-1343098391-project-member] Enqueued Resource ID: 7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 with Priority: HIGHEST for action security_group_members [ 950.988917] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 with Priority: HIGHEST for action security_group_members [ 950.989101] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.989502] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.119092] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 342236f2-0599-467d-9a3f-60c3778214c2 [ 951.119092] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.119092] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.119092] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.119092] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.119092] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.119373] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:342236f2-0599-467d-9a3f-60c3778214c2 already deleted. [ 951.119373] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-342236f2-0599-467d-9a3f-60c3778214c2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.244190] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.244352] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.244430] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.245032] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.245032] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.245032] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.245273] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.245273] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.245418] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.245449] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.245620] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea is going to be updated. [ 951.280456] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.280641] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.280714] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.280946] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.281566] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.293446] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea in Status: IN_PROGRESS for 2s [ 951.446114] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock network-201 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.446395] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "network-201" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.446546] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "network-201" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.446816] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "network-201" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.447105] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.447270] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.447554] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.447619] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.447740] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.447949] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 951.448071] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 951.448181] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 951.448306] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 951.448410] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 951.448513] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 951.448641] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 951.469108] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 951.469387] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 951.471937] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 951.471937] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "network-201" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.471937] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock port-a3980710-3a8a-4bed-9f0c-d26ba50ddecc taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.471937] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "port-a3980710-3a8a-4bed-9f0c-d26ba50ddecc" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.471937] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "port-a3980710-3a8a-4bed-9f0c-d26ba50ddecc" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.471937] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "port-a3980710-3a8a-4bed-9f0c-d26ba50ddecc" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.471937] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3980710-3a8a-4bed-9f0c-d26ba50ddecc',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.965238] env[65471]: INFO networking_nsxv3.common.synchronization [req-c3c38a71-95f5-4483-854b-f6b527fd5c12 req-19d1ec9b-bddc-48ec-a6c9-f70fe4f42cc5 tempest-ListServerFiltersTestJSON-1343098391 tempest-ListServerFiltersTestJSON-1343098391-project-member] Enqueued Resource ID: 7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 with Priority: HIGHEST for action security_group_members [ 951.965652] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 with Priority: HIGHEST for action security_group_members [ 951.965958] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.966097] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.973409] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.973612] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.973731] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.974018] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.974169] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.974320] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Segment Port a3980710-3a8a-4bed-9f0c-d26ba50ddecc not found, creating... [ 951.974632] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.974791] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.974906] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.975141] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.975275] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.975549] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.975700] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.975812] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.976018] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.976151] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.976307] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Resource: SegmentPort with ID: a3980710-3a8a-4bed-9f0c-d26ba50ddecc is going to be created. [ 952.001006] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.001337] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.001541] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.001794] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.002374] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.002614] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "port-a3980710-3a8a-4bed-9f0c-d26ba50ddecc" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.249745] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 in Status: SUCCESS [ 952.249976] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.250678] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.251008] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.251554] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.251749] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.251875] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.252394] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.252645] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.252855] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.252982] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7b0e439e-ae4b-45e5-b678-0ea9b193c6d4',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.253931] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.254077] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.254273] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.254419] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.254509] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.254615] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.254698] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.255441] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b0e439e-ae4b-45e5-b678-0ea9b193c6d4',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.425031] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock network-201 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.425325] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "network-201" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.425455] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "network-201" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.425702] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "network-201" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.425969] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.426176] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.426311] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.426526] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.426665] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.426874] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 952.426985] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 952.427104] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 952.427211] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 952.427318] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 952.427423] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 952.427553] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 952.449275] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 952.452019] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 952.452019] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 952.452019] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "network-201" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.452019] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock port-f026605b-8816-4f2f-8235-a51628c66b14 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.452019] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "port-f026605b-8816-4f2f-8235-a51628c66b14" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.452019] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "port-f026605b-8816-4f2f-8235-a51628c66b14" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.452019] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "port-f026605b-8816-4f2f-8235-a51628c66b14" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.452019] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f026605b-8816-4f2f-8235-a51628c66b14',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.736050] env[65471]: INFO networking_nsxv3.common.synchronization [req-7922a330-13c2-4f5e-be47-b2cc339fea18 req-958a5922-22ec-4960-a576-8ddb6e5e9bfa service nova] Enqueued Resource ID: 7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 with Priority: HIGHEST for action security_group_rules [ 952.736050] env[65471]: INFO networking_nsxv3.common.synchronization [req-7922a330-13c2-4f5e-be47-b2cc339fea18 req-958a5922-22ec-4960-a576-8ddb6e5e9bfa service nova] Enqueued Resource ID: 7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 with Priority: HIGHEST for action security_group_members [ 952.736211] env[65471]: INFO networking_nsxv3.common.synchronization [req-7922a330-13c2-4f5e-be47-b2cc339fea18 req-958a5922-22ec-4960-a576-8ddb6e5e9bfa service nova] Enqueued Resource ID: a3980710-3a8a-4bed-9f0c-d26ba50ddecc with Priority: HIGHEST for action port [ 952.736852] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 with Priority: HIGHEST for action security_group_rules [ 952.736905] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 with Priority: HIGHEST for action security_group_members [ 952.737053] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3980710-3a8a-4bed-9f0c-d26ba50ddecc with Priority: HIGHEST for action port [ 952.737417] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.737535] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.737812] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.737912] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.738137] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-a3980710-3a8a-4bed-9f0c-d26ba50ddecc taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.738912] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a3980710-3a8a-4bed-9f0c-d26ba50ddecc" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.738912] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a3980710-3a8a-4bed-9f0c-d26ba50ddecc" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.738912] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a3980710-3a8a-4bed-9f0c-d26ba50ddecc" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.738912] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3980710-3a8a-4bed-9f0c-d26ba50ddecc',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.757278] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.757502] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.757630] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7b0e439e-ae4b-45e5-b678-0ea9b193c6d4',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.954605] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.954926] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.955066] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.955414] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.956010] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.956316] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Segment Port f026605b-8816-4f2f-8235-a51628c66b14 not found, creating... [ 952.956646] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.956855] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.957059] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.957248] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.957395] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.957716] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.957871] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.957986] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.958474] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.958541] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.958671] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Resource: SegmentPort with ID: f026605b-8816-4f2f-8235-a51628c66b14 is going to be created. [ 952.970128] env[65471]: INFO networking_nsxv3.common.synchronization [req-5776e7da-3c32-4749-9202-db73c3957fbe req-553f3114-8297-459f-8af6-b80c861741b1 tempest-SecurityGroupRulesTestJSON-897669021 tempest-SecurityGroupRulesTestJSON-897669021-project-member] Enqueued Resource ID: 4dbb747e-1c0d-4858-b57a-4a3dc68f61ab with Priority: HIGHEST for action security_group_rules [ 952.970864] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dbb747e-1c0d-4858-b57a-4a3dc68f61ab with Priority: HIGHEST for action security_group_rules [ 952.971384] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4dbb747e-1c0d-4858-b57a-4a3dc68f61ab taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.971558] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4dbb747e-1c0d-4858-b57a-4a3dc68f61ab" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.971627] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4dbb747e-1c0d-4858-b57a-4a3dc68f61ab" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.971928] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4dbb747e-1c0d-4858-b57a-4a3dc68f61ab" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.972093] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4dbb747e-1c0d-4858-b57a-4a3dc68f61ab',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.982853] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.983070] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.983227] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.983888] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.983888] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.984047] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "port-f026605b-8816-4f2f-8235-a51628c66b14" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.242885] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a3980710-3a8a-4bed-9f0c-d26ba50ddecc with status ACTIVE [ 953.242885] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.242885] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.242885] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.242885] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.242885] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.242885] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.242885] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.242885] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.242885] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.242885] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.243963] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.243963] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.243963] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.243963] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.243963] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.243963] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a3980710-3a8a-4bed-9f0c-d26ba50ddecc is going to be updated. [ 953.260754] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7b0e439e-ae4b-45e5-b678-0ea9b193c6d4',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.268782] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.268959] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.269044] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.269694] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.269910] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.270776] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a3980710-3a8a-4bed-9f0c-d26ba50ddecc" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.303613] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea in Status: SUCCESS [ 953.304512] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea deletion is rescheduled due to dependency. [ 953.304744] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.387759] env[65471]: INFO networking_nsxv3.common.synchronization [None req-76f64ed6-fdbb-41d1-af6f-21a69f8aea09 None None] Enqueued Resource ID: 4f29fef1-53f6-4f2f-a067-485aaa81b0c9 with Priority: HIGHEST for action port [ 953.388349] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f29fef1-53f6-4f2f-a067-485aaa81b0c9 with Priority: HIGHEST for action port [ 953.389765] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-4f29fef1-53f6-4f2f-a067-485aaa81b0c9 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.390649] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4f29fef1-53f6-4f2f-a067-485aaa81b0c9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.390775] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4f29fef1-53f6-4f2f-a067-485aaa81b0c9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.391207] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4f29fef1-53f6-4f2f-a067-485aaa81b0c9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.391291] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f29fef1-53f6-4f2f-a067-485aaa81b0c9',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.502471] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.502628] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.502815] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.503787] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.503942] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.504039] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4dbb747e-1c0d-4858-b57a-4a3dc68f61ab already deleted. [ 953.504127] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4dbb747e-1c0d-4858-b57a-4a3dc68f61ab" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.612487] env[65471]: INFO networking_nsxv3.common.synchronization [None req-4ee46a74-e21f-4a13-9e03-8f9bcdedd85f None None] Enqueued Resource ID: 4f9e0905-c74f-46c9-b50b-e4b0ef3d3f89 with Priority: HIGHEST for action port [ 953.613105] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f9e0905-c74f-46c9-b50b-e4b0ef3d3f89 with Priority: HIGHEST for action port [ 953.613441] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-4f9e0905-c74f-46c9-b50b-e4b0ef3d3f89 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.613691] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4f9e0905-c74f-46c9-b50b-e4b0ef3d3f89" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.613691] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4f9e0905-c74f-46c9-b50b-e4b0ef3d3f89" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.614916] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4f9e0905-c74f-46c9-b50b-e4b0ef3d3f89" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.614916] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f9e0905-c74f-46c9-b50b-e4b0ef3d3f89',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.766065] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.766065] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.766065] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.766975] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.766975] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.766975] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 is going to be updated. [ 953.802872] env[65471]: INFO networking_nsxv3.common.synchronization [req-c3c38a71-95f5-4483-854b-f6b527fd5c12 req-aead7be1-0950-47ab-9a40-4db3e2a0685b service nova] Enqueued Resource ID: 7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 with Priority: HIGHEST for action security_group_rules [ 953.803392] env[65471]: INFO networking_nsxv3.common.synchronization [req-c3c38a71-95f5-4483-854b-f6b527fd5c12 req-aead7be1-0950-47ab-9a40-4db3e2a0685b service nova] Enqueued Resource ID: 7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 with Priority: HIGHEST for action security_group_members [ 953.803561] env[65471]: INFO networking_nsxv3.common.synchronization [req-c3c38a71-95f5-4483-854b-f6b527fd5c12 req-aead7be1-0950-47ab-9a40-4db3e2a0685b service nova] Enqueued Resource ID: f026605b-8816-4f2f-8235-a51628c66b14 with Priority: HIGHEST for action port [ 953.805078] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 with Priority: HIGHEST for action security_group_rules [ 953.805310] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 with Priority: HIGHEST for action security_group_members [ 953.805511] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f026605b-8816-4f2f-8235-a51628c66b14 with Priority: HIGHEST for action port [ 953.806917] env[65471]: INFO networking_nsxv3.common.synchronization [None req-e5ca4b7f-e8b0-45f2-a0ab-186ae8422777 tempest-AttachVolumeTestJSON-782575626 tempest-AttachVolumeTestJSON-782575626-project-member] Enqueued Resource ID: 748c6b66-3e73-44a5-8430-c76b55ad8ee3 with Priority: HIGHEST for action security_group_rules [ 953.810720] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.810870] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.811041] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.811225] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.811329] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.812532] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.812630] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.812826] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.812904] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.813190] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-f026605b-8816-4f2f-8235-a51628c66b14 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.813643] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f026605b-8816-4f2f-8235-a51628c66b14" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.813643] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f026605b-8816-4f2f-8235-a51628c66b14" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.813643] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f026605b-8816-4f2f-8235-a51628c66b14" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.813795] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f026605b-8816-4f2f-8235-a51628c66b14',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.817834] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 748c6b66-3e73-44a5-8430-c76b55ad8ee3 with Priority: HIGHEST for action security_group_rules [ 953.818278] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-748c6b66-3e73-44a5-8430-c76b55ad8ee3 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.818383] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-748c6b66-3e73-44a5-8430-c76b55ad8ee3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.818383] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-748c6b66-3e73-44a5-8430-c76b55ad8ee3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.818601] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-748c6b66-3e73-44a5-8430-c76b55ad8ee3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.819942] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('748c6b66-3e73-44a5-8430-c76b55ad8ee3',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.833705] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 in Status: IN_PROGRESS for 2s [ 953.893563] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4f29fef1-53f6-4f2f-a067-485aaa81b0c9 [ 953.893922] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.894069] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.894143] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.894381] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.894798] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.894971] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4f29fef1-53f6-4f2f-a067-485aaa81b0c9 already deleted. [ 953.895247] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4f29fef1-53f6-4f2f-a067-485aaa81b0c9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.958164] env[65471]: INFO networking_nsxv3.common.synchronization [None req-d73a9679-d36e-4c9b-a538-b4a64315f21b tempest-AttachVolumeTestJSON-782575626 tempest-AttachVolumeTestJSON-782575626-project-member] Enqueued Resource ID: 748c6b66-3e73-44a5-8430-c76b55ad8ee3 with Priority: HIGHEST for action security_group_rules [ 953.958792] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 748c6b66-3e73-44a5-8430-c76b55ad8ee3 with Priority: HIGHEST for action security_group_rules [ 953.959148] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-748c6b66-3e73-44a5-8430-c76b55ad8ee3 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.959901] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-748c6b66-3e73-44a5-8430-c76b55ad8ee3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.119754] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4f9e0905-c74f-46c9-b50b-e4b0ef3d3f89 [ 954.121189] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.121314] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.121383] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.121643] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.121785] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.121917] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4f9e0905-c74f-46c9-b50b-e4b0ef3d3f89 already deleted. [ 954.122075] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4f9e0905-c74f-46c9-b50b-e4b0ef3d3f89" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.318988] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f026605b-8816-4f2f-8235-a51628c66b14 with status ACTIVE [ 954.318988] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.319283] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.319946] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.319946] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.319946] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.319946] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.320208] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.320208] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.320551] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.320653] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.321417] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.321417] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.321417] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.321417] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.321417] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.321417] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f026605b-8816-4f2f-8235-a51628c66b14 is going to be updated. [ 954.350130] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.350403] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.350403] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.350861] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.350861] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.350861] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 748c6b66-3e73-44a5-8430-c76b55ad8ee3 already deleted. [ 954.350861] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-748c6b66-3e73-44a5-8430-c76b55ad8ee3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.351093] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-748c6b66-3e73-44a5-8430-c76b55ad8ee3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.351281] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-748c6b66-3e73-44a5-8430-c76b55ad8ee3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.351363] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('748c6b66-3e73-44a5-8430-c76b55ad8ee3',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.354122] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.354342] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.354416] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.354732] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.354900] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.355123] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f026605b-8816-4f2f-8235-a51628c66b14" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.875580] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.875580] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.875580] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.875580] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.875580] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.875580] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 748c6b66-3e73-44a5-8430-c76b55ad8ee3 already deleted. [ 954.875580] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-748c6b66-3e73-44a5-8430-c76b55ad8ee3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.847097] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 in Status: SUCCESS [ 955.847482] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.847760] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.848115] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.849195] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.849195] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.849195] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.849195] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.849195] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.849419] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b0e439e-ae4b-45e5-b678-0ea9b193c6d4',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.036305] env[65471]: INFO networking_nsxv3.common.synchronization [req-a6442d6f-7408-4e26-b3e8-141ef8dd88ad req-fd18105b-ccac-4fec-a51c-dc7b9427d23f tempest-SecurityGroupRulesTestJSON-897669021 tempest-SecurityGroupRulesTestJSON-897669021-project-member] Enqueued Resource ID: 67e8d478-fc13-492c-8962-2925b6b6013f with Priority: HIGHEST for action security_group_rules [ 956.036889] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67e8d478-fc13-492c-8962-2925b6b6013f with Priority: HIGHEST for action security_group_rules [ 956.037240] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-67e8d478-fc13-492c-8962-2925b6b6013f taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.037363] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-67e8d478-fc13-492c-8962-2925b6b6013f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.037420] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-67e8d478-fc13-492c-8962-2925b6b6013f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.037681] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-67e8d478-fc13-492c-8962-2925b6b6013f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.037766] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('67e8d478-fc13-492c-8962-2925b6b6013f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.352813] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7b0e439e-ae4b-45e5-b678-0ea9b193c6d4',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.567531] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.567735] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.567735] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.567891] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.567986] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.568118] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 67e8d478-fc13-492c-8962-2925b6b6013f already deleted. [ 956.568211] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-67e8d478-fc13-492c-8962-2925b6b6013f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.856086] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7b0e439e-ae4b-45e5-b678-0ea9b193c6d4',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.884365] env[65471]: INFO networking_nsxv3.common.synchronization [req-c0ec2926-1105-4e43-a32f-f5d444bd29ff req-7c714a71-0f2d-41db-8f42-cd7217e88646 tempest-SecurityGroupRulesTestJSON-897669021 tempest-SecurityGroupRulesTestJSON-897669021-project-member] Enqueued Resource ID: 4c73b8a8-24d9-462a-877b-6a8cb014f862 with Priority: HIGHEST for action security_group_rules [ 956.884365] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c73b8a8-24d9-462a-877b-6a8cb014f862 with Priority: HIGHEST for action security_group_rules [ 956.884365] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c73b8a8-24d9-462a-877b-6a8cb014f862 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.884365] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c73b8a8-24d9-462a-877b-6a8cb014f862" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.884602] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c73b8a8-24d9-462a-877b-6a8cb014f862" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.885140] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c73b8a8-24d9-462a-877b-6a8cb014f862" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.885257] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c73b8a8-24d9-462a-877b-6a8cb014f862',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.193828] env[65471]: INFO networking_nsxv3.common.synchronization [req-4238fafd-846d-4034-b51f-62d789e372b4 req-d86b5161-c492-485a-a0f2-50d1b243a055 tempest-ServersNegativeTestMultiTenantJSON-1431647548 tempest-ServersNegativeTestMultiTenantJSON-1431647548-project-member] Enqueued Resource ID: 4c8b1bad-5c54-463c-bc01-ad71c5f5f863 with Priority: HIGHEST for action security_group_members [ 957.194651] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c8b1bad-5c54-463c-bc01-ad71c5f5f863 with Priority: HIGHEST for action security_group_members [ 957.196040] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c8b1bad-5c54-463c-bc01-ad71c5f5f863 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.196821] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c8b1bad-5c54-463c-bc01-ad71c5f5f863" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.196821] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c8b1bad-5c54-463c-bc01-ad71c5f5f863" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.196821] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c8b1bad-5c54-463c-bc01-ad71c5f5f863" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.196821] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.197522] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.197681] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.197888] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.198032] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.198290] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c8b1bad-5c54-463c-bc01-ad71c5f5f863',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.358780] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.358880] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.358930] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.359249] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.359249] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.359448] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 is going to be updated. [ 957.413329] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.413485] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.413563] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.413786] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.413874] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.413969] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c73b8a8-24d9-462a-877b-6a8cb014f862 already deleted. [ 957.414084] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c73b8a8-24d9-462a-877b-6a8cb014f862" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.421023] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.421165] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.421238] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.421455] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.421643] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.432677] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 in Status: IN_PROGRESS for 2s [ 957.436880] env[65471]: INFO networking_nsxv3.common.synchronization [req-1e09dee4-8239-4902-a6e6-7616f69dfde7 req-02f5c4e8-c9f4-4370-913a-a25dbbb0ab8b tempest-ImagesOneServerNegativeTestJSON-124059679 tempest-ImagesOneServerNegativeTestJSON-124059679-project-member] Enqueued Resource ID: a3c5f688-9271-4722-84e9-69667c674933 with Priority: HIGHEST for action security_group_members [ 957.436880] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3c5f688-9271-4722-84e9-69667c674933 with Priority: HIGHEST for action security_group_members [ 957.437148] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3c5f688-9271-4722-84e9-69667c674933 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.437264] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.437328] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.437521] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.438078] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.438078] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.438078] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.438078] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.438363] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.438363] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a3c5f688-9271-4722-84e9-69667c674933',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.656030] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock network-656 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.656030] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "network-656" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.657022] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "network-656" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.657022] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "network-656" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.657022] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.657394] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.657631] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.658017] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.658330] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.659856] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 957.660173] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 957.661024] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 957.661024] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 957.661024] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 957.661024] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 957.661024] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 957.686042] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 957.686042] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 957.686042] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 957.686042] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "network-656" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.686042] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock port-16c2ee6a-f781-4fd2-a9a9-1ddc84101596 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.686042] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "port-16c2ee6a-f781-4fd2-a9a9-1ddc84101596" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.686042] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "port-16c2ee6a-f781-4fd2-a9a9-1ddc84101596" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.687057] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "port-16c2ee6a-f781-4fd2-a9a9-1ddc84101596" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.687346] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16c2ee6a-f781-4fd2-a9a9-1ddc84101596',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.703778] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.703778] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.703778] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.703778] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.703778] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.703778] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.703778] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.703778] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.703778] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.703778] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.703778] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c8b1bad-5c54-463c-bc01-ad71c5f5f863 already deleted. [ 957.703778] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c8b1bad-5c54-463c-bc01-ad71c5f5f863" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.940664] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.940664] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.940664] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.941566] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.941759] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.942620] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.942620] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.942620] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.942620] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.943012] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.943012] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3c5f688-9271-4722-84e9-69667c674933 is going to be updated. [ 957.976812] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.977101] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.977322] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.977494] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.977749] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.989441] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3c5f688-9271-4722-84e9-69667c674933 in Status: IN_PROGRESS for 2s [ 958.189981] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.190295] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.190637] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.191084] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.191335] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.191520] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Segment Port 16c2ee6a-f781-4fd2-a9a9-1ddc84101596 not found, creating... [ 958.191864] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.192286] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.192408] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.192705] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.192954] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.193384] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.193548] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.193680] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.193935] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.194092] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.194424] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Resource: SegmentPort with ID: 16c2ee6a-f781-4fd2-a9a9-1ddc84101596 is going to be created. [ 958.230085] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.230085] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.230432] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.230714] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.231037] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.232599] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "port-16c2ee6a-f781-4fd2-a9a9-1ddc84101596" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.417700] env[65471]: INFO networking_nsxv3.common.synchronization [req-7df14063-56c5-4a3c-b462-ac9e93ed483b req-562670ff-7ff0-4869-afb1-b58ecb8ab741 tempest-SecurityGroupRulesTestJSON-897669021 tempest-SecurityGroupRulesTestJSON-897669021-project-member] Enqueued Resource ID: 4db8c8ed-7ebd-438a-8ba4-25ecd8685d5c with Priority: HIGHEST for action security_group_rules [ 958.418394] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4db8c8ed-7ebd-438a-8ba4-25ecd8685d5c with Priority: HIGHEST for action security_group_rules [ 958.418921] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4db8c8ed-7ebd-438a-8ba4-25ecd8685d5c taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.419209] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4db8c8ed-7ebd-438a-8ba4-25ecd8685d5c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.419315] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4db8c8ed-7ebd-438a-8ba4-25ecd8685d5c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.419921] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4db8c8ed-7ebd-438a-8ba4-25ecd8685d5c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.420160] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4db8c8ed-7ebd-438a-8ba4-25ecd8685d5c',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.653071] env[65471]: INFO networking_nsxv3.common.synchronization [req-2a87060e-ecf4-4df9-9b03-a119cb9d39b9 req-fb0c99af-e9ce-447f-b644-3291af372fe1 tempest-SecurityGroupRulesTestJSON-897669021 tempest-SecurityGroupRulesTestJSON-897669021-project-member] Enqueued Resource ID: 4db8c8ed-7ebd-438a-8ba4-25ecd8685d5c with Priority: HIGHEST for action security_group_rules [ 958.653466] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4db8c8ed-7ebd-438a-8ba4-25ecd8685d5c with Priority: HIGHEST for action security_group_rules [ 958.653790] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4db8c8ed-7ebd-438a-8ba4-25ecd8685d5c taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.653942] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4db8c8ed-7ebd-438a-8ba4-25ecd8685d5c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.926547] env[65471]: INFO networking_nsxv3.common.synchronization [req-0460a38c-bbe3-465d-8739-633dc1235307 req-4e5df9bc-2c80-4bf7-8f81-359c9312bba3 tempest-SecurityGroupRulesTestJSON-897669021 tempest-SecurityGroupRulesTestJSON-897669021-project-member] Enqueued Resource ID: 4db8c8ed-7ebd-438a-8ba4-25ecd8685d5c with Priority: HIGHEST for action security_group_rules [ 958.927700] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4db8c8ed-7ebd-438a-8ba4-25ecd8685d5c with Priority: HIGHEST for action security_group_rules [ 958.928458] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4db8c8ed-7ebd-438a-8ba4-25ecd8685d5c taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.928458] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4db8c8ed-7ebd-438a-8ba4-25ecd8685d5c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.947302] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.947737] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.947737] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.947838] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.948773] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.948773] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4db8c8ed-7ebd-438a-8ba4-25ecd8685d5c already deleted. [ 958.948773] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4db8c8ed-7ebd-438a-8ba4-25ecd8685d5c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.948773] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4db8c8ed-7ebd-438a-8ba4-25ecd8685d5c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.948773] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4db8c8ed-7ebd-438a-8ba4-25ecd8685d5c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.949083] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4db8c8ed-7ebd-438a-8ba4-25ecd8685d5c',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.005273] env[65471]: INFO networking_nsxv3.common.synchronization [req-4238fafd-846d-4034-b51f-62d789e372b4 req-0933c34b-946c-46b6-b8ad-18f8efaa4157 service nova] Enqueued Resource ID: 4c8b1bad-5c54-463c-bc01-ad71c5f5f863 with Priority: HIGHEST for action security_group_rules [ 959.005445] env[65471]: INFO networking_nsxv3.common.synchronization [req-4238fafd-846d-4034-b51f-62d789e372b4 req-0933c34b-946c-46b6-b8ad-18f8efaa4157 service nova] Enqueued Resource ID: 4c8b1bad-5c54-463c-bc01-ad71c5f5f863 with Priority: HIGHEST for action security_group_members [ 959.005627] env[65471]: INFO networking_nsxv3.common.synchronization [req-4238fafd-846d-4034-b51f-62d789e372b4 req-0933c34b-946c-46b6-b8ad-18f8efaa4157 service nova] Enqueued Resource ID: 16c2ee6a-f781-4fd2-a9a9-1ddc84101596 with Priority: HIGHEST for action port [ 959.006087] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c8b1bad-5c54-463c-bc01-ad71c5f5f863 with Priority: HIGHEST for action security_group_rules [ 959.006191] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c8b1bad-5c54-463c-bc01-ad71c5f5f863 with Priority: HIGHEST for action security_group_members [ 959.006290] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16c2ee6a-f781-4fd2-a9a9-1ddc84101596 with Priority: HIGHEST for action port [ 959.006563] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c8b1bad-5c54-463c-bc01-ad71c5f5f863 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.006677] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c8b1bad-5c54-463c-bc01-ad71c5f5f863" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.006743] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c8b1bad-5c54-463c-bc01-ad71c5f5f863" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.007027] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c8b1bad-5c54-463c-bc01-ad71c5f5f863" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.007086] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c8b1bad-5c54-463c-bc01-ad71c5f5f863',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.007906] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c8b1bad-5c54-463c-bc01-ad71c5f5f863 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.008016] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c8b1bad-5c54-463c-bc01-ad71c5f5f863" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.008092] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c8b1bad-5c54-463c-bc01-ad71c5f5f863" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.008454] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c8b1bad-5c54-463c-bc01-ad71c5f5f863" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.008626] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.008736] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.008800] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.009064] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.009064] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.009329] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c8b1bad-5c54-463c-bc01-ad71c5f5f863',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.010586] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-16c2ee6a-f781-4fd2-a9a9-1ddc84101596 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.010699] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-16c2ee6a-f781-4fd2-a9a9-1ddc84101596" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.010767] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-16c2ee6a-f781-4fd2-a9a9-1ddc84101596" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.011098] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-16c2ee6a-f781-4fd2-a9a9-1ddc84101596" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.011098] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16c2ee6a-f781-4fd2-a9a9-1ddc84101596',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.446970] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 in Status: SUCCESS [ 959.447229] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.447506] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.447840] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.448109] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.449077] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.449077] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.449077] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.449077] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.449077] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b0e439e-ae4b-45e5-b678-0ea9b193c6d4',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.480432] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.480432] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.480432] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.480432] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.480742] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.480742] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4db8c8ed-7ebd-438a-8ba4-25ecd8685d5c already deleted. [ 959.480742] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4db8c8ed-7ebd-438a-8ba4-25ecd8685d5c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.480868] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4db8c8ed-7ebd-438a-8ba4-25ecd8685d5c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.482545] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4db8c8ed-7ebd-438a-8ba4-25ecd8685d5c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.482545] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4db8c8ed-7ebd-438a-8ba4-25ecd8685d5c',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.512696] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4c8b1bad-5c54-463c-bc01-ad71c5f5f863',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.514709] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c8b1bad-5c54-463c-bc01-ad71c5f5f863 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.514918] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c8b1bad-5c54-463c-bc01-ad71c5f5f863" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.515077] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 16c2ee6a-f781-4fd2-a9a9-1ddc84101596 with status ACTIVE [ 959.515418] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.515418] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.515527] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.515761] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.515814] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.515979] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.517421] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.517421] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.517421] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.517573] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.517953] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.518143] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.518253] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.518569] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.518641] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.518845] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 16c2ee6a-f781-4fd2-a9a9-1ddc84101596 is going to be updated. [ 959.549194] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.549434] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.549561] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.549805] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.549989] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.550449] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-16c2ee6a-f781-4fd2-a9a9-1ddc84101596" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.805893] env[65471]: INFO networking_nsxv3.common.synchronization [req-a6e01e25-9307-4ca5-80db-64ec50e104bd req-0b02c6b2-4b7b-409f-8aa4-1a59df7a9277 tempest-AttachInterfacesTestJSON-1197806586 tempest-AttachInterfacesTestJSON-1197806586-project-member] Enqueued Resource ID: c6d2b8aa-4881-48a5-899c-b24d6eb08e70 with Priority: HIGHEST for action security_group_members [ 959.806438] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6d2b8aa-4881-48a5-899c-b24d6eb08e70 with Priority: HIGHEST for action security_group_members [ 959.806774] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6d2b8aa-4881-48a5-899c-b24d6eb08e70 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.806899] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6d2b8aa-4881-48a5-899c-b24d6eb08e70" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.806991] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6d2b8aa-4881-48a5-899c-b24d6eb08e70" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.807318] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6d2b8aa-4881-48a5-899c-b24d6eb08e70" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.807589] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.807675] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.807744] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.807908] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.807994] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.808184] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6d2b8aa-4881-48a5-899c-b24d6eb08e70',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.952511] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7b0e439e-ae4b-45e5-b678-0ea9b193c6d4',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.002425] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3c5f688-9271-4722-84e9-69667c674933 in Status: SUCCESS [ 960.002425] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3c5f688-9271-4722-84e9-69667c674933 deletion is rescheduled due to dependency. [ 960.002425] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.009868] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.009868] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.009868] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.009868] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.009868] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.009868] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4db8c8ed-7ebd-438a-8ba4-25ecd8685d5c already deleted. [ 960.009868] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4db8c8ed-7ebd-438a-8ba4-25ecd8685d5c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.022131] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4c8b1bad-5c54-463c-bc01-ad71c5f5f863',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.202595] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock network-238 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.202810] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "network-238" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.202960] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "network-238" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.203617] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "network-238" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.203905] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.204086] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.204213] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.204468] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.204615] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.204821] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 960.204927] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 960.205052] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 960.205159] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 960.205283] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 960.205406] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 960.205544] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 960.228925] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 960.228925] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 960.228925] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 960.228925] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "network-238" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.229364] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock port-f539a2c0-51db-4d9c-97ce-405fdf28bece taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.229364] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "port-f539a2c0-51db-4d9c-97ce-405fdf28bece" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.229523] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "port-f539a2c0-51db-4d9c-97ce-405fdf28bece" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.229899] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "port-f539a2c0-51db-4d9c-97ce-405fdf28bece" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.230075] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f539a2c0-51db-4d9c-97ce-405fdf28bece',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.312828] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.313086] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.313191] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.313518] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.313668] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.313958] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.314129] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.314243] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.314493] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.314747] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.314828] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6d2b8aa-4881-48a5-899c-b24d6eb08e70 already deleted. [ 960.315423] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6d2b8aa-4881-48a5-899c-b24d6eb08e70" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.458482] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7b0e439e-ae4b-45e5-b678-0ea9b193c6d4',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.524438] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.524642] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.524716] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.524999] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.525072] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.525158] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c8b1bad-5c54-463c-bc01-ad71c5f5f863 is going to be created. [ 960.551045] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.551255] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.551346] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.551574] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.551744] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.562576] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c8b1bad-5c54-463c-bc01-ad71c5f5f863 in Status: UNINITIALIZED for 2s [ 960.736025] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.736025] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.736025] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.736025] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.736025] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.736025] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Segment Port f539a2c0-51db-4d9c-97ce-405fdf28bece not found, creating... [ 960.736025] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.736025] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.736025] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.736025] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.736025] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.736796] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.736796] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.736796] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.736796] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.737341] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.737893] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Resource: SegmentPort with ID: f539a2c0-51db-4d9c-97ce-405fdf28bece is going to be created. [ 960.764571] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.764571] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.764571] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.764571] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.764571] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.764571] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "port-f539a2c0-51db-4d9c-97ce-405fdf28bece" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.960087] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.960523] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.960523] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.960779] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.960921] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.961062] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 is going to be updated. [ 960.993588] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.993780] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.993912] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.994237] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.994462] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.010367] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 in Status: IN_PROGRESS for 2s [ 961.531275] env[65471]: INFO networking_nsxv3.common.synchronization [req-a6e01e25-9307-4ca5-80db-64ec50e104bd req-cb5f9956-4d25-4229-a1c6-f39d3f269ad6 service nova] Enqueued Resource ID: c6d2b8aa-4881-48a5-899c-b24d6eb08e70 with Priority: HIGHEST for action security_group_rules [ 961.531275] env[65471]: INFO networking_nsxv3.common.synchronization [req-a6e01e25-9307-4ca5-80db-64ec50e104bd req-cb5f9956-4d25-4229-a1c6-f39d3f269ad6 service nova] Enqueued Resource ID: c6d2b8aa-4881-48a5-899c-b24d6eb08e70 with Priority: HIGHEST for action security_group_members [ 961.531275] env[65471]: INFO networking_nsxv3.common.synchronization [req-a6e01e25-9307-4ca5-80db-64ec50e104bd req-cb5f9956-4d25-4229-a1c6-f39d3f269ad6 service nova] Enqueued Resource ID: f539a2c0-51db-4d9c-97ce-405fdf28bece with Priority: HIGHEST for action port [ 961.531275] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6d2b8aa-4881-48a5-899c-b24d6eb08e70 with Priority: HIGHEST for action security_group_rules [ 961.531275] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6d2b8aa-4881-48a5-899c-b24d6eb08e70 with Priority: HIGHEST for action security_group_members [ 961.531275] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f539a2c0-51db-4d9c-97ce-405fdf28bece with Priority: HIGHEST for action port [ 961.531667] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c6d2b8aa-4881-48a5-899c-b24d6eb08e70 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.531924] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c6d2b8aa-4881-48a5-899c-b24d6eb08e70" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.532139] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c6d2b8aa-4881-48a5-899c-b24d6eb08e70" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.532488] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c6d2b8aa-4881-48a5-899c-b24d6eb08e70" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.532759] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c6d2b8aa-4881-48a5-899c-b24d6eb08e70',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.536113] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6d2b8aa-4881-48a5-899c-b24d6eb08e70 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.536113] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6d2b8aa-4881-48a5-899c-b24d6eb08e70" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.536113] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6d2b8aa-4881-48a5-899c-b24d6eb08e70" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.536113] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6d2b8aa-4881-48a5-899c-b24d6eb08e70" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.536113] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.536113] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.536113] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.536113] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.536113] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.536113] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6d2b8aa-4881-48a5-899c-b24d6eb08e70',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.536113] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-f539a2c0-51db-4d9c-97ce-405fdf28bece taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.536892] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f539a2c0-51db-4d9c-97ce-405fdf28bece" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.537150] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f539a2c0-51db-4d9c-97ce-405fdf28bece" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.537496] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f539a2c0-51db-4d9c-97ce-405fdf28bece" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.539030] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f539a2c0-51db-4d9c-97ce-405fdf28bece',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.931681] env[65471]: INFO networking_nsxv3.common.synchronization [req-59795936-b7bc-4eed-8cb9-4354e1227b7a req-43d154f6-3ac2-4ca0-8b5b-b86068972967 tempest-ImagesTestJSON-650286870 tempest-ImagesTestJSON-650286870-project-member] Enqueued Resource ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f with Priority: HIGHEST for action security_group_members [ 961.933511] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f with Priority: HIGHEST for action security_group_members [ 961.934642] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-85af6c5e-2f9b-491d-9584-96c44b20f99f taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.934779] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.934847] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.935061] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.935217] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.935314] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.935379] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.935525] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.935624] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.935714] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85af6c5e-2f9b-491d-9584-96c44b20f99f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.039300] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6d2b8aa-4881-48a5-899c-b24d6eb08e70 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.039608] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6d2b8aa-4881-48a5-899c-b24d6eb08e70" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.039723] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c6d2b8aa-4881-48a5-899c-b24d6eb08e70',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.040665] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f539a2c0-51db-4d9c-97ce-405fdf28bece with status ACTIVE [ 962.040863] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.041014] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.041244] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.041519] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.041626] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.041855] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.042202] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.042346] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.042650] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.042798] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.042999] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.043119] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.043181] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.043419] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.043546] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.043704] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f539a2c0-51db-4d9c-97ce-405fdf28bece is going to be updated. [ 962.071846] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.072043] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.072159] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.072459] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.072618] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.072787] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f539a2c0-51db-4d9c-97ce-405fdf28bece" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.438070] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('85af6c5e-2f9b-491d-9584-96c44b20f99f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.547546] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c6d2b8aa-4881-48a5-899c-b24d6eb08e70',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.574629] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c8b1bad-5c54-463c-bc01-ad71c5f5f863 in Status: SUCCESS [ 962.574876] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c8b1bad-5c54-463c-bc01-ad71c5f5f863" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.575067] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c8b1bad-5c54-463c-bc01-ad71c5f5f863" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.575278] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c8b1bad-5c54-463c-bc01-ad71c5f5f863" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.575477] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.575603] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.575669] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.575797] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.575910] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.576036] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c8b1bad-5c54-463c-bc01-ad71c5f5f863" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.576159] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4c8b1bad-5c54-463c-bc01-ad71c5f5f863',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.940521] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('85af6c5e-2f9b-491d-9584-96c44b20f99f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.026149] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 in Status: SUCCESS [ 963.026489] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.026961] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.026961] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.027158] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.027158] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.027293] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.027391] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.027632] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.027632] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.027716] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.028176] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.028176] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.028176] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.028176] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.028433] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.028433] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.028433] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.028534] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.029093] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.029873] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7b0e439e-ae4b-45e5-b678-0ea9b193c6d4',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.030062] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.030225] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.030563] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.030680] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.030723] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.030877] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.030931] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.031028] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b0e439e-ae4b-45e5-b678-0ea9b193c6d4',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.049567] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.049848] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.049848] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.050014] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.050105] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.050205] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6d2b8aa-4881-48a5-899c-b24d6eb08e70 is going to be created. [ 963.075853] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.075972] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.076114] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.076233] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.076383] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.081563] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c8b1bad-5c54-463c-bc01-ad71c5f5f863 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.081732] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c8b1bad-5c54-463c-bc01-ad71c5f5f863" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.081804] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c8b1bad-5c54-463c-bc01-ad71c5f5f863" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.082013] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c8b1bad-5c54-463c-bc01-ad71c5f5f863" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.082193] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.082355] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.082421] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.082589] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.082675] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.082763] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c8b1bad-5c54-463c-bc01-ad71c5f5f863" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.082910] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c8b1bad-5c54-463c-bc01-ad71c5f5f863 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.083008] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c8b1bad-5c54-463c-bc01-ad71c5f5f863" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.083072] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c8b1bad-5c54-463c-bc01-ad71c5f5f863" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.083211] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c8b1bad-5c54-463c-bc01-ad71c5f5f863" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.083376] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.083494] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.083553] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.083700] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.083762] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.083861] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c8b1bad-5c54-463c-bc01-ad71c5f5f863" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.083955] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4c8b1bad-5c54-463c-bc01-ad71c5f5f863',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.087379] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6d2b8aa-4881-48a5-899c-b24d6eb08e70 in Status: UNINITIALIZED for 2s [ 963.443608] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.443767] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.443834] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.444088] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.444180] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.444280] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f is going to be updated. [ 963.478212] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.479154] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.479154] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.479154] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.479154] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.492042] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f in Status: IN_PROGRESS for 2s [ 963.534045] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7b0e439e-ae4b-45e5-b678-0ea9b193c6d4: rpc.has_security_group_logging(os_id): False [ 963.535148] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7b0e439e-ae4b-45e5-b678-0ea9b193c6d4',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.553575] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.553575] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.553575] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.553575] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.553575] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.553935] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.553935] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.553935] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.554150] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.554150] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.554274] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.554475] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.554475] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.554565] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.554612] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.554831] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.554926] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.554987] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.555174] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.555260] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.555349] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 is going to be created. [ 963.586814] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4c8b1bad-5c54-463c-bc01-ad71c5f5f863: rpc.has_security_group_logging(os_id): False [ 963.607104] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.607265] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.607485] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.607567] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.607673] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.608111] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.608111] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.608111] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.608289] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.608356] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.608557] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.608657] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.608780] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.608894] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.608966] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.610667] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.610667] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.611741] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.611946] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.612064] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.612176] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c8b1bad-5c54-463c-bc01-ad71c5f5f863 is going to be created. [ 963.677496] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.677742] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.677819] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.678197] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.678505] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.696252] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 in Status: IN_PROGRESS for 2s [ 963.731130] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.733975] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.733975] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.733975] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.733975] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.747609] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c8b1bad-5c54-463c-bc01-ad71c5f5f863 in Status: IN_PROGRESS for 2s [ 964.039395] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7b0e439e-ae4b-45e5-b678-0ea9b193c6d4',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.545229] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.546899] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.546899] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.546899] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.546899] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.546899] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 is going to be updated. [ 964.583025] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.583025] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.583025] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.583025] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.583025] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.592187] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 in Status: IN_PROGRESS for 2s [ 965.100039] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6d2b8aa-4881-48a5-899c-b24d6eb08e70 in Status: SUCCESS [ 965.100332] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6d2b8aa-4881-48a5-899c-b24d6eb08e70" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.100546] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6d2b8aa-4881-48a5-899c-b24d6eb08e70" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.100816] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6d2b8aa-4881-48a5-899c-b24d6eb08e70" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.101282] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.101282] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.101282] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.102057] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.102057] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.102057] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6d2b8aa-4881-48a5-899c-b24d6eb08e70" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.102057] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c6d2b8aa-4881-48a5-899c-b24d6eb08e70',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.509782] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f in Status: SUCCESS [ 965.509987] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.605237] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c6d2b8aa-4881-48a5-899c-b24d6eb08e70',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.710190] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 in Status: SUCCESS [ 965.710730] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.711152] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.711355] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.711355] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7b0e439e-ae4b-45e5-b678-0ea9b193c6d4',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.758994] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c8b1bad-5c54-463c-bc01-ad71c5f5f863 in Status: SUCCESS [ 965.759257] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c8b1bad-5c54-463c-bc01-ad71c5f5f863" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.904173] env[65471]: INFO networking_nsxv3.common.synchronization [None req-0f62e498-b1b6-4196-801e-9ecfcac157a6 None None] Enqueued Resource ID: b2b63803-8f67-4855-b063-8567715614c4 with Priority: HIGHEST for action port [ 965.904719] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2b63803-8f67-4855-b063-8567715614c4 with Priority: HIGHEST for action port [ 965.905331] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-b2b63803-8f67-4855-b063-8567715614c4 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.905526] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b2b63803-8f67-4855-b063-8567715614c4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.905640] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b2b63803-8f67-4855-b063-8567715614c4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.905955] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b2b63803-8f67-4855-b063-8567715614c4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.906125] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2b63803-8f67-4855-b063-8567715614c4',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.110129] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c6d2b8aa-4881-48a5-899c-b24d6eb08e70: rpc.has_security_group_logging(os_id): False [ 966.157337] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.157337] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.157337] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.157337] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.157337] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.157337] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.157337] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.157337] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.157337] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.157337] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.157337] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c6d2b8aa-4881-48a5-899c-b24d6eb08e70 is going to be created. [ 966.218469] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.218722] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.244034] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.244034] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.244034] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.244034] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.244034] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.266598] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c6d2b8aa-4881-48a5-899c-b24d6eb08e70 in Status: IN_PROGRESS for 2s [ 966.408206] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b2b63803-8f67-4855-b063-8567715614c4 [ 966.408451] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.408611] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.408689] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.408922] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.409035] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.409145] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b2b63803-8f67-4855-b063-8567715614c4 already deleted. [ 966.409230] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b2b63803-8f67-4855-b063-8567715614c4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.478830] env[65471]: INFO networking_nsxv3.common.synchronization [req-e032424f-1702-4352-a0b0-351019b20fe7 req-6df06408-c569-495d-9cb1-f10edf60c902 tempest-ServerRescueTestJSON-1224779364 tempest-ServerRescueTestJSON-1224779364-project-member] Enqueued Resource ID: a70c8576-d6c6-406f-8ebf-d5fb66c56b95 with Priority: HIGHEST for action security_group_members [ 966.478978] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a70c8576-d6c6-406f-8ebf-d5fb66c56b95 with Priority: HIGHEST for action security_group_members [ 966.479222] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-a70c8576-d6c6-406f-8ebf-d5fb66c56b95 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.479338] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a70c8576-d6c6-406f-8ebf-d5fb66c56b95" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.479559] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a70c8576-d6c6-406f-8ebf-d5fb66c56b95" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.479775] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a70c8576-d6c6-406f-8ebf-d5fb66c56b95" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.481488] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.481488] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.481488] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.481488] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.481488] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.481488] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a70c8576-d6c6-406f-8ebf-d5fb66c56b95',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.605881] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 in Status: SUCCESS [ 966.605881] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.605881] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.605881] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.605881] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.605881] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.605881] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.605881] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.605881] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.605881] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.605881] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7b0e439e-ae4b-45e5-b678-0ea9b193c6d4',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.984125] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.984279] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.984403] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.984613] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.984706] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.984845] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.984950] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.985026] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.985173] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.985251] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.985337] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a70c8576-d6c6-406f-8ebf-d5fb66c56b95 is going to be updated. [ 967.013573] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.013718] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.013779] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.014105] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.014269] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.030139] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a70c8576-d6c6-406f-8ebf-d5fb66c56b95 in Status: IN_PROGRESS for 2s [ 967.109042] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.109042] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.109042] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.109335] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.109528] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.109528] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.109676] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.109901] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.109901] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.110022] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.110233] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.110378] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.110378] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.110661] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.110661] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.110746] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.110864] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.111104] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.111104] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.111186] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.111264] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7b0e439e-ae4b-45e5-b678-0ea9b193c6d4',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.613656] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7b0e439e-ae4b-45e5-b678-0ea9b193c6d4: rpc.has_security_group_logging(os_id): False [ 967.637043] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.637043] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.637043] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.637043] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.637043] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.637043] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.637043] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.637043] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.637043] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.637043] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.637043] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.637602] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.637602] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.637602] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.637602] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.637602] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.637762] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.637762] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.638601] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.638601] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.638601] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 is going to be updated. [ 967.742850] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.743140] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.743140] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.743423] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.743543] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.758443] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 in Status: IN_PROGRESS for 2s [ 968.016980] env[65471]: INFO networking_nsxv3.common.synchronization [req-ac77f27c-5cf5-4a74-81e0-2de7be189bb7 req-4916d78b-c007-416b-b3a3-af69b2307200 tempest-ServerActionsTestOtherA-1623203122 tempest-ServerActionsTestOtherA-1623203122-project-member] Enqueued Resource ID: 0c92cf42-7023-4aba-91c3-95f84d379c9f with Priority: HIGHEST for action security_group_members [ 968.017393] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c92cf42-7023-4aba-91c3-95f84d379c9f with Priority: HIGHEST for action security_group_members [ 968.018039] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c92cf42-7023-4aba-91c3-95f84d379c9f taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.018039] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c92cf42-7023-4aba-91c3-95f84d379c9f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.018039] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c92cf42-7023-4aba-91c3-95f84d379c9f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.019109] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c92cf42-7023-4aba-91c3-95f84d379c9f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.019306] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.019419] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.019525] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.019683] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.019734] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.019835] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c92cf42-7023-4aba-91c3-95f84d379c9f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.281028] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c6d2b8aa-4881-48a5-899c-b24d6eb08e70 in Status: SUCCESS [ 968.281333] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c6d2b8aa-4881-48a5-899c-b24d6eb08e70" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.480777] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock network-344 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.480986] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "network-344" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.481126] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "network-344" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.481400] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "network-344" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.481663] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.481818] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.481934] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.482168] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.482382] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.482603] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 968.482745] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 968.482851] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 968.482956] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 968.483073] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 968.483178] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 968.483335] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 968.502881] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 968.503111] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 968.503311] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 968.503473] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "network-344" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.503785] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock port-9d77d687-1b12-4764-b9fe-2565415fc25e taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.503954] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "port-9d77d687-1b12-4764-b9fe-2565415fc25e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.504082] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "port-9d77d687-1b12-4764-b9fe-2565415fc25e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.504402] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "port-9d77d687-1b12-4764-b9fe-2565415fc25e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.504545] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d77d687-1b12-4764-b9fe-2565415fc25e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.526651] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.526828] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.526944] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.527275] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.527377] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.527509] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.527634] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.527697] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.527866] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.527990] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.528147] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c92cf42-7023-4aba-91c3-95f84d379c9f already deleted. [ 968.528292] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c92cf42-7023-4aba-91c3-95f84d379c9f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.008183] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.008569] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.008569] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.008869] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.009030] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.009186] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Segment Port 9d77d687-1b12-4764-b9fe-2565415fc25e not found, creating... [ 969.009436] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.009578] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.009687] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.009924] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.010065] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.010357] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.010499] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.010608] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.010875] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.011428] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.011643] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Resource: SegmentPort with ID: 9d77d687-1b12-4764-b9fe-2565415fc25e is going to be created. [ 969.033833] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.034061] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.034181] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.034453] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.034720] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.035023] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "port-9d77d687-1b12-4764-b9fe-2565415fc25e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.041978] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a70c8576-d6c6-406f-8ebf-d5fb66c56b95 in Status: SUCCESS [ 969.042187] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a70c8576-d6c6-406f-8ebf-d5fb66c56b95 deletion is rescheduled due to dependency. [ 969.042354] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a70c8576-d6c6-406f-8ebf-d5fb66c56b95" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.128395] env[65471]: INFO networking_nsxv3.common.synchronization [None req-78ad849f-2c1d-4c0a-b95f-a42238989489 None None] Enqueued Resource ID: 2ae3175c-acc2-4fb5-9628-be83ab5c358c with Priority: HIGHEST for action port [ 969.130022] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ae3175c-acc2-4fb5-9628-be83ab5c358c with Priority: HIGHEST for action port [ 969.130479] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ae3175c-acc2-4fb5-9628-be83ab5c358c taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.130619] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ae3175c-acc2-4fb5-9628-be83ab5c358c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.130797] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ae3175c-acc2-4fb5-9628-be83ab5c358c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.131028] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ae3175c-acc2-4fb5-9628-be83ab5c358c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.133042] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ae3175c-acc2-4fb5-9628-be83ab5c358c',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.469878] env[65471]: INFO networking_nsxv3.common.synchronization [req-a01b3175-b165-425b-a9b8-4c6632ded148 req-61ac9608-dcfc-4750-9e61-f87913e19663 tempest-MigrationsAdminTest-433965692 tempest-MigrationsAdminTest-433965692-project-member] Enqueued Resource ID: 2ecf6012-bc6c-4512-8d9d-962c10f0cad9 with Priority: HIGHEST for action security_group_members [ 969.471729] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ecf6012-bc6c-4512-8d9d-962c10f0cad9 with Priority: HIGHEST for action security_group_members [ 969.471872] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.472017] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.472093] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.472498] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.472949] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.473131] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.473131] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.473322] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.473447] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.473518] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ecf6012-bc6c-4512-8d9d-962c10f0cad9',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.637857] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2ae3175c-acc2-4fb5-9628-be83ab5c358c [ 969.637857] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.637857] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.637857] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.637857] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.637857] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.637857] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2ae3175c-acc2-4fb5-9628-be83ab5c358c already deleted. [ 969.637857] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ae3175c-acc2-4fb5-9628-be83ab5c358c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.776565] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 in Status: SUCCESS [ 969.776565] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.776565] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.776781] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.776875] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7b0e439e-ae4b-45e5-b678-0ea9b193c6d4',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.797315] env[65471]: INFO networking_nsxv3.common.synchronization [req-ac77f27c-5cf5-4a74-81e0-2de7be189bb7 req-6f7ea14e-3cc8-44c8-81f9-2d2fa5b94c25 service nova] Enqueued Resource ID: 0c92cf42-7023-4aba-91c3-95f84d379c9f with Priority: HIGHEST for action security_group_rules [ 969.797499] env[65471]: INFO networking_nsxv3.common.synchronization [req-ac77f27c-5cf5-4a74-81e0-2de7be189bb7 req-6f7ea14e-3cc8-44c8-81f9-2d2fa5b94c25 service nova] Enqueued Resource ID: 0c92cf42-7023-4aba-91c3-95f84d379c9f with Priority: HIGHEST for action security_group_members [ 969.797633] env[65471]: INFO networking_nsxv3.common.synchronization [req-ac77f27c-5cf5-4a74-81e0-2de7be189bb7 req-6f7ea14e-3cc8-44c8-81f9-2d2fa5b94c25 service nova] Enqueued Resource ID: 9d77d687-1b12-4764-b9fe-2565415fc25e with Priority: HIGHEST for action port [ 969.800053] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c92cf42-7023-4aba-91c3-95f84d379c9f with Priority: HIGHEST for action security_group_rules [ 969.800053] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c92cf42-7023-4aba-91c3-95f84d379c9f with Priority: HIGHEST for action security_group_members [ 969.800233] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d77d687-1b12-4764-b9fe-2565415fc25e with Priority: HIGHEST for action port [ 969.801028] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c92cf42-7023-4aba-91c3-95f84d379c9f taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.801028] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c92cf42-7023-4aba-91c3-95f84d379c9f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.801198] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c92cf42-7023-4aba-91c3-95f84d379c9f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.801303] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c92cf42-7023-4aba-91c3-95f84d379c9f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.801360] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c92cf42-7023-4aba-91c3-95f84d379c9f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.802242] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c92cf42-7023-4aba-91c3-95f84d379c9f taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.803149] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c92cf42-7023-4aba-91c3-95f84d379c9f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.803149] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c92cf42-7023-4aba-91c3-95f84d379c9f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.803149] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c92cf42-7023-4aba-91c3-95f84d379c9f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.803149] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.803149] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.803149] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.803149] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.803415] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.803415] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c92cf42-7023-4aba-91c3-95f84d379c9f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.805356] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d77d687-1b12-4764-b9fe-2565415fc25e taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.805548] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d77d687-1b12-4764-b9fe-2565415fc25e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.805637] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d77d687-1b12-4764-b9fe-2565415fc25e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.805789] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d77d687-1b12-4764-b9fe-2565415fc25e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.806236] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d77d687-1b12-4764-b9fe-2565415fc25e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.979133] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.979305] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.979373] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.979592] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.000497] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.001930] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.001930] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.001930] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.001930] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.001930] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.001930] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ecf6012-bc6c-4512-8d9d-962c10f0cad9 is going to be updated. [ 970.030853] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.031230] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.031270] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.031503] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.031687] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.040477] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ecf6012-bc6c-4512-8d9d-962c10f0cad9 in Status: IN_PROGRESS for 2s [ 970.279321] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.279491] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.279602] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.279855] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.280970] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.281274] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.281274] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.281456] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.281580] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.281774] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.281774] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7b0e439e-ae4b-45e5-b678-0ea9b193c6d4',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.306868] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0c92cf42-7023-4aba-91c3-95f84d379c9f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.307474] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c92cf42-7023-4aba-91c3-95f84d379c9f taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.307584] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c92cf42-7023-4aba-91c3-95f84d379c9f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.307895] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9d77d687-1b12-4764-b9fe-2565415fc25e with status ACTIVE [ 970.310224] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.310224] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.310224] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.310224] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.310224] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.310224] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.310224] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.310224] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.310224] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.310224] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.310224] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.310224] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.310224] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.310224] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.310224] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.310224] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9d77d687-1b12-4764-b9fe-2565415fc25e is going to be updated. [ 970.334561] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.334796] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.334867] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.335088] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.335236] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.335397] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d77d687-1b12-4764-b9fe-2565415fc25e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.784803] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.785018] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.787470] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.788168] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.788456] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.788548] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.788613] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.788827] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.788943] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.789069] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.789254] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.789349] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.789410] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.789552] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.789693] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.789781] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.789842] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.789979] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.790065] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.790142] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.790254] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7b0e439e-ae4b-45e5-b678-0ea9b193c6d4',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.813037] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0c92cf42-7023-4aba-91c3-95f84d379c9f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.292073] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7b0e439e-ae4b-45e5-b678-0ea9b193c6d4: rpc.has_security_group_logging(os_id): False [ 971.315520] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.315520] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.315520] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.315520] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.315520] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.316292] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c92cf42-7023-4aba-91c3-95f84d379c9f is going to be created. [ 971.323559] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.323559] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.323559] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.323893] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.323893] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.323957] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.324050] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.324196] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.324322] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.324422] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.324735] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.324851] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.324915] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.325098] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.325179] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.325418] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.325490] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.325805] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.325805] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.325805] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.325888] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 is going to be updated. [ 971.352964] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.352964] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.353132] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.353232] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.353426] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.366286] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c92cf42-7023-4aba-91c3-95f84d379c9f in Status: UNINITIALIZED for 2s [ 971.411196] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.411463] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.411609] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.411898] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.412164] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.428450] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 in Status: IN_PROGRESS for 2s [ 972.050449] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ecf6012-bc6c-4512-8d9d-962c10f0cad9 in Status: SUCCESS [ 972.050639] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ecf6012-bc6c-4512-8d9d-962c10f0cad9 deletion is rescheduled due to dependency. [ 972.050759] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.376707] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c92cf42-7023-4aba-91c3-95f84d379c9f in Status: SUCCESS [ 973.377046] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c92cf42-7023-4aba-91c3-95f84d379c9f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.377127] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c92cf42-7023-4aba-91c3-95f84d379c9f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.377351] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c92cf42-7023-4aba-91c3-95f84d379c9f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.378031] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.378031] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.378031] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.378031] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.378031] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.378273] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c92cf42-7023-4aba-91c3-95f84d379c9f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.378273] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0c92cf42-7023-4aba-91c3-95f84d379c9f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.442682] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 in Status: SUCCESS [ 973.442845] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.881139] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0c92cf42-7023-4aba-91c3-95f84d379c9f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.186265] env[65471]: INFO networking_nsxv3.common.synchronization [None req-8272c385-5044-4bc6-ac4a-b091f5206216 tempest-ServerDiskConfigTestJSON-1443816332 tempest-ServerDiskConfigTestJSON-1443816332-project-member] Enqueued Resource ID: 6dd226b0-7cb8-4230-ab70-ed96299d55f0 with Priority: HIGHEST for action security_group_rules [ 974.186887] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dd226b0-7cb8-4230-ab70-ed96299d55f0 with Priority: HIGHEST for action security_group_rules [ 974.187336] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6dd226b0-7cb8-4230-ab70-ed96299d55f0 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.187396] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6dd226b0-7cb8-4230-ab70-ed96299d55f0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.187431] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6dd226b0-7cb8-4230-ab70-ed96299d55f0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.187967] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6dd226b0-7cb8-4230-ab70-ed96299d55f0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.187967] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6dd226b0-7cb8-4230-ab70-ed96299d55f0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.322611] env[65471]: INFO networking_nsxv3.common.synchronization [None req-93625f7c-d885-43c0-bcba-f0b8dd31c89c tempest-ServerDiskConfigTestJSON-1443816332 tempest-ServerDiskConfigTestJSON-1443816332-project-member] Enqueued Resource ID: 6dd226b0-7cb8-4230-ab70-ed96299d55f0 with Priority: HIGHEST for action security_group_rules [ 974.323987] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dd226b0-7cb8-4230-ab70-ed96299d55f0 with Priority: HIGHEST for action security_group_rules [ 974.324131] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6dd226b0-7cb8-4230-ab70-ed96299d55f0 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.324725] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6dd226b0-7cb8-4230-ab70-ed96299d55f0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.385201] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0c92cf42-7023-4aba-91c3-95f84d379c9f: rpc.has_security_group_logging(os_id): False [ 974.404205] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.404318] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.404366] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.404572] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.404912] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.404988] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.405090] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.405153] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.405328] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.405409] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.405468] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c92cf42-7023-4aba-91c3-95f84d379c9f is going to be created. [ 974.478052] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.478220] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.478296] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.478517] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.478786] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.494279] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c92cf42-7023-4aba-91c3-95f84d379c9f in Status: IN_PROGRESS for 2s [ 974.710721] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.710721] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.710721] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.710942] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.710942] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.711024] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6dd226b0-7cb8-4230-ab70-ed96299d55f0 already deleted. [ 974.711086] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6dd226b0-7cb8-4230-ab70-ed96299d55f0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.711252] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6dd226b0-7cb8-4230-ab70-ed96299d55f0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.711419] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6dd226b0-7cb8-4230-ab70-ed96299d55f0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.711506] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6dd226b0-7cb8-4230-ab70-ed96299d55f0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.241332] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.241574] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.241574] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.241751] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.241841] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.241935] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6dd226b0-7cb8-4230-ab70-ed96299d55f0 already deleted. [ 975.242028] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6dd226b0-7cb8-4230-ab70-ed96299d55f0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.349464] env[65471]: INFO networking_nsxv3.common.synchronization [req-b0acd647-0d32-46f8-be89-88856bf35946 req-b11269d4-8130-49a8-a286-b9c962647bbe tempest-ServersNegativeTestMultiTenantJSON-1431647548 tempest-ServersNegativeTestMultiTenantJSON-1431647548-project-member] Enqueued Resource ID: 4c8b1bad-5c54-463c-bc01-ad71c5f5f863 with Priority: HIGHEST for action security_group_members [ 975.353598] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c8b1bad-5c54-463c-bc01-ad71c5f5f863 with Priority: HIGHEST for action security_group_members [ 975.353713] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c8b1bad-5c54-463c-bc01-ad71c5f5f863 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.353831] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c8b1bad-5c54-463c-bc01-ad71c5f5f863" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.353871] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c8b1bad-5c54-463c-bc01-ad71c5f5f863" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.354076] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c8b1bad-5c54-463c-bc01-ad71c5f5f863" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.354237] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.354350] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.354425] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.354582] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.354761] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.355037] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c8b1bad-5c54-463c-bc01-ad71c5f5f863',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.858568] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.860501] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.860501] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.860501] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.860501] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.860501] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.860501] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.860501] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.860501] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.860501] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.860501] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c8b1bad-5c54-463c-bc01-ad71c5f5f863 is going to be updated. [ 975.892264] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.892488] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.892590] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.892896] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.893133] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.905364] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c8b1bad-5c54-463c-bc01-ad71c5f5f863 in Status: IN_PROGRESS for 2s [ 976.506946] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c92cf42-7023-4aba-91c3-95f84d379c9f in Status: SUCCESS [ 976.507205] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c92cf42-7023-4aba-91c3-95f84d379c9f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.590773] env[65471]: INFO networking_nsxv3.common.synchronization [req-9683f0e5-1719-44bf-88a2-170cd476cbc3 req-ba4c1cab-3d85-4aee-a358-91e19dbedc82 tempest-ServerDiskConfigTestJSON-1443816332 tempest-ServerDiskConfigTestJSON-1443816332-project-member] Enqueued Resource ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e with Priority: HIGHEST for action security_group_members [ 977.591451] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e with Priority: HIGHEST for action security_group_members [ 977.591775] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.591934] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.591968] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.592254] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.592514] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.592651] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.592725] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.592939] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.593052] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.593182] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c8a6eda-c0ec-4e25-8652-6acf3d57da4e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.917762] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c8b1bad-5c54-463c-bc01-ad71c5f5f863 in Status: SUCCESS [ 977.917980] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c8b1bad-5c54-463c-bc01-ad71c5f5f863 deletion is rescheduled due to dependency. [ 977.918175] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c8b1bad-5c54-463c-bc01-ad71c5f5f863" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.096069] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.096069] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.096069] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.096349] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.096507] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.096822] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.096986] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.097110] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.097357] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.097483] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.097618] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e is going to be updated. [ 978.126864] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.126996] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.127182] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.127446] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.127789] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.138272] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e in Status: IN_PROGRESS for 2s [ 978.787644] env[65471]: INFO networking_nsxv3.common.synchronization [req-1f027351-14af-4839-a95e-83d090f77b3b req-d3d0c771-68de-4637-b56b-0c3b4cbebb2d tempest-MultipleCreateTestJSON-1803706331 tempest-MultipleCreateTestJSON-1803706331-project-member] Enqueued Resource ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe with Priority: HIGHEST for action security_group_members [ 978.788524] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe with Priority: HIGHEST for action security_group_members [ 978.788873] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-34e45751-3d11-4d8a-ad9f-272d1ad803fe taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.789030] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.789095] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.789342] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.789643] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.789757] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.789815] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.790013] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.790104] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.790199] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34e45751-3d11-4d8a-ad9f-272d1ad803fe',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.182042] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock network-151 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.182042] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "network-151" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.182042] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "network-151" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.182407] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "network-151" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.182646] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.182814] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.182927] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.183176] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.183350] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.183602] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 979.183716] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 979.183823] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 979.183995] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 979.184061] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 979.184155] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 979.184284] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 979.205735] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 979.206015] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 979.206216] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 979.206465] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "network-151" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.206856] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock port-fe0f488d-45c1-4dff-9b14-46b0147a94f1 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.207097] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "port-fe0f488d-45c1-4dff-9b14-46b0147a94f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.207274] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "port-fe0f488d-45c1-4dff-9b14-46b0147a94f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.207661] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "port-fe0f488d-45c1-4dff-9b14-46b0147a94f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.207826] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe0f488d-45c1-4dff-9b14-46b0147a94f1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.292753] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.293747] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.293747] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.293747] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.293747] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.293945] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.293945] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.294878] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.295145] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.295241] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.295335] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe already deleted. [ 979.295878] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.348684] env[65471]: INFO networking_nsxv3.common.synchronization [None req-501e7c9c-8813-404c-9cf2-9ec07e784dc8 tempest-AttachVolumeNegativeTest-275281664 tempest-AttachVolumeNegativeTest-275281664-project-member] Enqueued Resource ID: 8c8d67e4-5b19-43b8-b618-1f0b1d72c71a with Priority: HIGHEST for action security_group_rules [ 979.349236] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c8d67e4-5b19-43b8-b618-1f0b1d72c71a with Priority: HIGHEST for action security_group_rules [ 979.349552] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c8d67e4-5b19-43b8-b618-1f0b1d72c71a taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.349672] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c8d67e4-5b19-43b8-b618-1f0b1d72c71a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.349930] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c8d67e4-5b19-43b8-b618-1f0b1d72c71a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.350008] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c8d67e4-5b19-43b8-b618-1f0b1d72c71a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.350077] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c8d67e4-5b19-43b8-b618-1f0b1d72c71a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.486097] env[65471]: INFO networking_nsxv3.common.synchronization [None req-ddb7fb2b-43a6-490a-9fb1-c3de960885bb tempest-AttachVolumeNegativeTest-275281664 tempest-AttachVolumeNegativeTest-275281664-project-member] Enqueued Resource ID: 8c8d67e4-5b19-43b8-b618-1f0b1d72c71a with Priority: HIGHEST for action security_group_rules [ 979.486274] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c8d67e4-5b19-43b8-b618-1f0b1d72c71a with Priority: HIGHEST for action security_group_rules [ 979.486583] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c8d67e4-5b19-43b8-b618-1f0b1d72c71a taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.486708] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c8d67e4-5b19-43b8-b618-1f0b1d72c71a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.710930] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.711172] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.711297] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.711591] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.711735] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.711892] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Segment Port fe0f488d-45c1-4dff-9b14-46b0147a94f1 not found, creating... [ 979.712222] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.712326] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.712467] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.712694] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.712845] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.713192] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.713362] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.713479] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.713697] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.713821] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.713956] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Resource: SegmentPort with ID: fe0f488d-45c1-4dff-9b14-46b0147a94f1 is going to be created. [ 979.734417] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.734417] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.734566] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.734762] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.734996] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.735236] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "port-fe0f488d-45c1-4dff-9b14-46b0147a94f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.882905] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.883393] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.883393] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.883393] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.883548] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.883780] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c8d67e4-5b19-43b8-b618-1f0b1d72c71a already deleted. [ 979.883878] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c8d67e4-5b19-43b8-b618-1f0b1d72c71a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.884068] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c8d67e4-5b19-43b8-b618-1f0b1d72c71a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.884260] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c8d67e4-5b19-43b8-b618-1f0b1d72c71a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.884347] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c8d67e4-5b19-43b8-b618-1f0b1d72c71a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.149453] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e in Status: SUCCESS [ 980.149682] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e deletion is rescheduled due to dependency. [ 980.149811] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.407783] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.408052] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.408052] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.408228] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.408332] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.408441] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c8d67e4-5b19-43b8-b618-1f0b1d72c71a already deleted. [ 980.408523] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c8d67e4-5b19-43b8-b618-1f0b1d72c71a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.473154] env[65471]: INFO networking_nsxv3.common.synchronization [req-1f027351-14af-4839-a95e-83d090f77b3b req-f6643b76-873f-466b-94aa-b1b8db857f9c service nova] Enqueued Resource ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe with Priority: HIGHEST for action security_group_rules [ 980.473536] env[65471]: INFO networking_nsxv3.common.synchronization [req-1f027351-14af-4839-a95e-83d090f77b3b req-f6643b76-873f-466b-94aa-b1b8db857f9c service nova] Enqueued Resource ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe with Priority: HIGHEST for action security_group_members [ 980.473809] env[65471]: INFO networking_nsxv3.common.synchronization [req-1f027351-14af-4839-a95e-83d090f77b3b req-f6643b76-873f-466b-94aa-b1b8db857f9c service nova] Enqueued Resource ID: fe0f488d-45c1-4dff-9b14-46b0147a94f1 with Priority: HIGHEST for action port [ 980.476477] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe with Priority: HIGHEST for action security_group_rules [ 980.476477] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe with Priority: HIGHEST for action security_group_members [ 980.476477] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe0f488d-45c1-4dff-9b14-46b0147a94f1 with Priority: HIGHEST for action port [ 980.476477] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34e45751-3d11-4d8a-ad9f-272d1ad803fe taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.476865] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.476865] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.477103] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.477242] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34e45751-3d11-4d8a-ad9f-272d1ad803fe',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.478487] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-34e45751-3d11-4d8a-ad9f-272d1ad803fe taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.478664] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.478775] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.479141] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.479383] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.479542] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.479650] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.479883] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.480036] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.480285] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34e45751-3d11-4d8a-ad9f-272d1ad803fe',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.481336] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe0f488d-45c1-4dff-9b14-46b0147a94f1 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.481691] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe0f488d-45c1-4dff-9b14-46b0147a94f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.481691] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe0f488d-45c1-4dff-9b14-46b0147a94f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.481986] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe0f488d-45c1-4dff-9b14-46b0147a94f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.481986] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe0f488d-45c1-4dff-9b14-46b0147a94f1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.717903] env[65471]: INFO networking_nsxv3.common.synchronization [req-3c1c7df8-3fba-4e5c-8f7c-34bbe77d24cf req-1e20e9c3-4b66-4b91-891c-ee8d0ab9d291 tempest-ListServerFiltersTestJSON-1343098391 tempest-ListServerFiltersTestJSON-1343098391-project-member] Enqueued Resource ID: 7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 with Priority: HIGHEST for action security_group_members [ 980.717903] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 with Priority: HIGHEST for action security_group_members [ 980.718239] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.718359] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.718439] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.718669] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.718829] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.720906] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.720906] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.720906] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.720906] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.720906] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b0e439e-ae4b-45e5-b678-0ea9b193c6d4',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.986347] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-34e45751-3d11-4d8a-ad9f-272d1ad803fe taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.986722] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.986801] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('34e45751-3d11-4d8a-ad9f-272d1ad803fe',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.987739] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fe0f488d-45c1-4dff-9b14-46b0147a94f1 with status ACTIVE [ 980.987947] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.988053] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.988126] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.988325] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.988412] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.988584] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.988680] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.988742] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.988939] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.989052] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.989237] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.989329] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.989442] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.989522] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.989593] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.989679] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fe0f488d-45c1-4dff-9b14-46b0147a94f1 is going to be updated. [ 981.013523] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.013740] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.013740] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.013936] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.014085] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.017258] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe0f488d-45c1-4dff-9b14-46b0147a94f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.221843] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7b0e439e-ae4b-45e5-b678-0ea9b193c6d4',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.492211] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('34e45751-3d11-4d8a-ad9f-272d1ad803fe',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.728034] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7b0e439e-ae4b-45e5-b678-0ea9b193c6d4',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.995551] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.995848] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.995848] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.996053] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.996121] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.996229] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe is going to be created. [ 982.027717] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.027843] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.027978] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.028238] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.028396] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.040245] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe in Status: UNINITIALIZED for 2s [ 982.236789] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.236789] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.236789] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.237022] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.237022] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.237092] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 is going to be updated. [ 982.281543] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.281748] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.282099] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.282387] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.283195] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.294612] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 in Status: IN_PROGRESS for 2s [ 983.438505] env[65471]: INFO networking_nsxv3.common.synchronization [req-1f027351-14af-4839-a95e-83d090f77b3b req-a24837bc-474f-4721-bbd0-c8c1894ab6dd tempest-MultipleCreateTestJSON-1803706331 tempest-MultipleCreateTestJSON-1803706331-project-member] Enqueued Resource ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe with Priority: HIGHEST for action security_group_members [ 983.439369] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe with Priority: HIGHEST for action security_group_members [ 983.439843] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-34e45751-3d11-4d8a-ad9f-272d1ad803fe taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.439993] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.904359] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock network-151 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.904359] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "network-151" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.904359] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "network-151" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.904652] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "network-151" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.905151] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.905623] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.905623] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.905880] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.906110] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.906492] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 983.906589] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 983.906758] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 983.906947] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 983.907228] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 983.907418] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 983.907630] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 983.937421] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 983.937421] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 983.937421] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 983.937421] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "network-151" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.937421] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock port-0e3a0cfc-727c-4517-92a0-de2d1ed95a15 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.937421] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "port-0e3a0cfc-727c-4517-92a0-de2d1ed95a15" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.937421] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "port-0e3a0cfc-727c-4517-92a0-de2d1ed95a15" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.937789] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "port-0e3a0cfc-727c-4517-92a0-de2d1ed95a15" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.937789] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e3a0cfc-727c-4517-92a0-de2d1ed95a15',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.055572] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe in Status: SUCCESS [ 984.055869] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.056060] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.056281] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.056489] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.056602] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.056678] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.056819] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.056917] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.057065] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.057209] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('34e45751-3d11-4d8a-ad9f-272d1ad803fe',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.059041] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.059224] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.059403] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.059515] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.059577] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.060883] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.060985] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.061293] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34e45751-3d11-4d8a-ad9f-272d1ad803fe',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.314263] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 in Status: SUCCESS [ 984.315048] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.443136] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.443136] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.443136] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.443136] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.443136] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.443898] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Segment Port 0e3a0cfc-727c-4517-92a0-de2d1ed95a15 not found, creating... [ 984.443898] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.443898] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.443898] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.444245] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.444245] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.444481] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.444642] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.444772] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.445015] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.445212] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.445337] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Resource: SegmentPort with ID: 0e3a0cfc-727c-4517-92a0-de2d1ed95a15 is going to be created. [ 984.467745] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.467951] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.468148] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.468723] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.468979] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.469258] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "port-0e3a0cfc-727c-4517-92a0-de2d1ed95a15" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.566157] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-34e45751-3d11-4d8a-ad9f-272d1ad803fe taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.566342] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.566488] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('34e45751-3d11-4d8a-ad9f-272d1ad803fe',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.069448] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('34e45751-3d11-4d8a-ad9f-272d1ad803fe',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.201280] env[65471]: INFO networking_nsxv3.common.synchronization [req-1f027351-14af-4839-a95e-83d090f77b3b req-e94e8ddd-e465-4a71-b5c9-2fee03c88d74 service nova] Enqueued Resource ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe with Priority: HIGHEST for action security_group_rules [ 985.201381] env[65471]: INFO networking_nsxv3.common.synchronization [req-1f027351-14af-4839-a95e-83d090f77b3b req-e94e8ddd-e465-4a71-b5c9-2fee03c88d74 service nova] Enqueued Resource ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe with Priority: HIGHEST for action security_group_members [ 985.201576] env[65471]: INFO networking_nsxv3.common.synchronization [req-1f027351-14af-4839-a95e-83d090f77b3b req-e94e8ddd-e465-4a71-b5c9-2fee03c88d74 service nova] Enqueued Resource ID: 0e3a0cfc-727c-4517-92a0-de2d1ed95a15 with Priority: HIGHEST for action port [ 985.202329] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe with Priority: HIGHEST for action security_group_rules [ 985.202533] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe with Priority: HIGHEST for action security_group_members [ 985.202688] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e3a0cfc-727c-4517-92a0-de2d1ed95a15 with Priority: HIGHEST for action port [ 985.203226] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34e45751-3d11-4d8a-ad9f-272d1ad803fe taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.203335] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.203642] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-34e45751-3d11-4d8a-ad9f-272d1ad803fe taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.203785] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.204027] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-0e3a0cfc-727c-4517-92a0-de2d1ed95a15 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.204313] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0e3a0cfc-727c-4517-92a0-de2d1ed95a15" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.204313] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0e3a0cfc-727c-4517-92a0-de2d1ed95a15" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.204480] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0e3a0cfc-727c-4517-92a0-de2d1ed95a15" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.204588] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e3a0cfc-727c-4517-92a0-de2d1ed95a15',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.572125] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.572505] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.572505] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.572783] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.572906] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.573075] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe is going to be updated. [ 985.601490] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.601720] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.601720] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.601916] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.602043] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.612406] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe in Status: IN_PROGRESS for 2s [ 985.709402] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0e3a0cfc-727c-4517-92a0-de2d1ed95a15 with status ACTIVE [ 985.709402] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.709402] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.709402] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.709402] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.709402] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.709721] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.709797] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.709994] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.712182] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.712182] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.712182] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.712182] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.712182] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.712182] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.712182] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.712182] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0e3a0cfc-727c-4517-92a0-de2d1ed95a15 is going to be updated. [ 985.740846] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.741051] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.741117] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.741307] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.741445] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.742119] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0e3a0cfc-727c-4517-92a0-de2d1ed95a15" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.137943] env[65471]: INFO networking_nsxv3.common.synchronization [req-7691a96e-4b09-4d28-a02c-b7d05b8790e9 req-bd91c9fb-3b92-4939-a5cf-6aa25946b8d9 tempest-ServerActionsTestOtherB-402089456 tempest-ServerActionsTestOtherB-402089456-project-member] Enqueued Resource ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 with Priority: HIGHEST for action security_group_members [ 986.138780] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 with Priority: HIGHEST for action security_group_members [ 986.139174] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-b71ce0e0-83fe-4f36-8617-e29f83b0be32 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.139303] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.139362] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.139538] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.139703] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.139809] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.139866] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.139998] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.140093] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.140186] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b71ce0e0-83fe-4f36-8617-e29f83b0be32',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.529076] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock network-852 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.529289] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "network-852" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.529522] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "network-852" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.529678] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "network-852" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.529941] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.531108] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.531108] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.531365] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.531521] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.531828] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 986.531967] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 986.532145] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 986.532308] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 986.532521] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 986.532653] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 986.532869] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 986.554260] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 986.554260] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 986.554260] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 986.554260] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "network-852" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.554579] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock port-d78ba21e-102c-4449-befc-ca3bcb4fa063 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.554579] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "port-d78ba21e-102c-4449-befc-ca3bcb4fa063" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.554697] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "port-d78ba21e-102c-4449-befc-ca3bcb4fa063" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.555012] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "port-d78ba21e-102c-4449-befc-ca3bcb4fa063" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.555158] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d78ba21e-102c-4449-befc-ca3bcb4fa063',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.643057] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.643358] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.643358] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.643497] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.643589] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.643783] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.643881] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.643946] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.644111] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.644186] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.644272] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 is going to be updated. [ 986.668418] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.668591] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.668644] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.668843] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.669069] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.678227] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 in Status: IN_PROGRESS for 2s [ 987.057875] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.058282] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.058497] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.058917] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.059183] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.059424] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Segment Port d78ba21e-102c-4449-befc-ca3bcb4fa063 not found, creating... [ 987.059834] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.060105] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.060293] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.060562] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.060759] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.061011] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.061199] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.061317] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.061535] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.061670] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.061808] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Resource: SegmentPort with ID: d78ba21e-102c-4449-befc-ca3bcb4fa063 is going to be created. [ 987.084725] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.085053] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.085124] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.085409] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.085641] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.085876] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "port-d78ba21e-102c-4449-befc-ca3bcb4fa063" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.623645] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe in Status: SUCCESS [ 987.624286] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.624286] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.624443] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.624684] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.624684] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.624868] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.625970] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.625970] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.625970] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.625970] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-34e45751-3d11-4d8a-ad9f-272d1ad803fe taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.625970] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.626513] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.626513] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.626513] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.626513] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.626513] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.626709] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.626709] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.627277] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.627277] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('34e45751-3d11-4d8a-ad9f-272d1ad803fe',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.628043] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.628199] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.628344] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.628444] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.628507] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.628646] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.628721] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.628809] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34e45751-3d11-4d8a-ad9f-272d1ad803fe',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.797877] env[65471]: INFO networking_nsxv3.common.synchronization [req-7691a96e-4b09-4d28-a02c-b7d05b8790e9 req-1467488f-4ab3-4b9c-807c-d7c8710334bf service nova] Enqueued Resource ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 with Priority: HIGHEST for action security_group_rules [ 987.798166] env[65471]: INFO networking_nsxv3.common.synchronization [req-7691a96e-4b09-4d28-a02c-b7d05b8790e9 req-1467488f-4ab3-4b9c-807c-d7c8710334bf service nova] Enqueued Resource ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 with Priority: HIGHEST for action security_group_members [ 987.798297] env[65471]: INFO networking_nsxv3.common.synchronization [req-7691a96e-4b09-4d28-a02c-b7d05b8790e9 req-1467488f-4ab3-4b9c-807c-d7c8710334bf service nova] Enqueued Resource ID: d78ba21e-102c-4449-befc-ca3bcb4fa063 with Priority: HIGHEST for action port [ 987.798871] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 with Priority: HIGHEST for action security_group_rules [ 987.798943] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 with Priority: HIGHEST for action security_group_members [ 987.799009] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d78ba21e-102c-4449-befc-ca3bcb4fa063 with Priority: HIGHEST for action port [ 987.799297] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b71ce0e0-83fe-4f36-8617-e29f83b0be32 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.799409] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.799476] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.799675] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.799750] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b71ce0e0-83fe-4f36-8617-e29f83b0be32',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.802307] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-b71ce0e0-83fe-4f36-8617-e29f83b0be32 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.802307] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.802307] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-d78ba21e-102c-4449-befc-ca3bcb4fa063 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.802307] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d78ba21e-102c-4449-befc-ca3bcb4fa063" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.802307] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d78ba21e-102c-4449-befc-ca3bcb4fa063" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.802307] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d78ba21e-102c-4449-befc-ca3bcb4fa063" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.802307] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d78ba21e-102c-4449-befc-ca3bcb4fa063',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.130698] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 34e45751-3d11-4d8a-ad9f-272d1ad803fe: rpc.has_security_group_logging(os_id): False [ 988.133053] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('34e45751-3d11-4d8a-ad9f-272d1ad803fe',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.151304] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.151520] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.151652] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.151990] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.152171] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.152553] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.152713] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.152803] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.155068] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.155245] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.155952] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.156089] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.156192] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.156360] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.156478] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.156692] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.156825] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.156892] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.157086] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.157548] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.157548] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe is going to be created. [ 988.225067] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.225346] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.225725] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.225725] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.225943] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.238328] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe in Status: IN_PROGRESS for 2s [ 988.304016] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-b71ce0e0-83fe-4f36-8617-e29f83b0be32 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.304228] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.304352] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d78ba21e-102c-4449-befc-ca3bcb4fa063 with status ACTIVE [ 988.304526] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.304636] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.304699] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.304979] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.305078] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.305265] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.305362] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.305451] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.305585] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.305804] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.305855] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.305981] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.305981] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.306135] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.306207] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.306294] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d78ba21e-102c-4449-befc-ca3bcb4fa063 is going to be updated. [ 988.344891] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.345065] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.345155] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.345427] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.345598] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.345787] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d78ba21e-102c-4449-befc-ca3bcb4fa063" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.638104] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('34e45751-3d11-4d8a-ad9f-272d1ad803fe',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.692523] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 in Status: SUCCESS [ 988.692523] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 deletion is rescheduled due to dependency. [ 988.692523] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.692523] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.692523] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.692523] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.692523] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.692523] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.692523] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.692523] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.692523] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b71ce0e0-83fe-4f36-8617-e29f83b0be32',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.140661] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.141056] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.141056] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.141240] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.141361] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.141475] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe is going to be updated. [ 989.178082] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.178441] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.178441] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.178736] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.178909] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.193868] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe in Status: IN_PROGRESS for 2s [ 989.197316] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b71ce0e0-83fe-4f36-8617-e29f83b0be32',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.699962] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b71ce0e0-83fe-4f36-8617-e29f83b0be32',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.203320] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.203723] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.203723] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.203801] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.203886] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.203959] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 is going to be updated. [ 990.240984] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.241200] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.241200] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.241483] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.241691] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.252858] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 in Status: IN_PROGRESS for 2s [ 990.258032] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe in Status: SUCCESS [ 990.258161] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.258287] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.258559] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.258783] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34e45751-3d11-4d8a-ad9f-272d1ad803fe',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.545604] env[65471]: INFO networking_nsxv3.common.synchronization [req-44ec5480-a7fa-4602-aae8-9571d0139ba5 req-39b3e909-93cd-4c2a-8266-fd85a9305500 tempest-ImagesTestJSON-650286870 tempest-ImagesTestJSON-650286870-project-member] Enqueued Resource ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f with Priority: HIGHEST for action security_group_members [ 990.545604] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f with Priority: HIGHEST for action security_group_members [ 990.548785] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-85af6c5e-2f9b-491d-9584-96c44b20f99f taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.548785] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.548785] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.548785] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.548785] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.548785] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.548785] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.548785] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.548785] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.548785] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85af6c5e-2f9b-491d-9584-96c44b20f99f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.760722] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-34e45751-3d11-4d8a-ad9f-272d1ad803fe taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.760916] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.781310] env[65471]: INFO networking_nsxv3.common.synchronization [req-8aa384b7-abf6-4135-882e-607777a4a705 req-ee3b5ea6-4bb3-4213-bd58-cc006a41d4b4 tempest-AttachVolumeTestJSON-782575626 tempest-AttachVolumeTestJSON-782575626-project-member] Enqueued Resource ID: 748c6b66-3e73-44a5-8430-c76b55ad8ee3 with Priority: HIGHEST for action security_group_members [ 990.781948] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 748c6b66-3e73-44a5-8430-c76b55ad8ee3 with Priority: HIGHEST for action security_group_members [ 990.782325] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-748c6b66-3e73-44a5-8430-c76b55ad8ee3 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.782473] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-748c6b66-3e73-44a5-8430-c76b55ad8ee3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.782647] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-748c6b66-3e73-44a5-8430-c76b55ad8ee3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.782895] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-748c6b66-3e73-44a5-8430-c76b55ad8ee3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.783090] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.783198] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.783261] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.783423] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.783867] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.783991] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('748c6b66-3e73-44a5-8430-c76b55ad8ee3',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.052817] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.052817] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.052817] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.053357] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.053357] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.053357] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.053483] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.053516] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.053758] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.054126] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.054126] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f is going to be updated. [ 991.085402] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.085687] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.085687] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.086431] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.086431] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.095569] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f in Status: IN_PROGRESS for 2s [ 991.157411] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock network-906 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.157411] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "network-906" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.157411] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "network-906" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.157654] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "network-906" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.157933] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.158098] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.158468] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.158468] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.158560] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.158814] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 991.158935] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 991.162022] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 991.162022] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 991.162022] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 991.162022] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 991.162022] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 991.182965] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 991.183163] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 991.183297] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 991.183505] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "network-906" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.183894] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock port-33166197-95da-4f6d-8e68-4274c6b07ee8 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.184028] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "port-33166197-95da-4f6d-8e68-4274c6b07ee8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.184139] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "port-33166197-95da-4f6d-8e68-4274c6b07ee8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.184553] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "port-33166197-95da-4f6d-8e68-4274c6b07ee8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.184718] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33166197-95da-4f6d-8e68-4274c6b07ee8',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.209444] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe in Status: SUCCESS [ 991.210045] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.210045] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.210168] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.210921] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.210921] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.210921] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.210921] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.210921] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.210921] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.210921] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('34e45751-3d11-4d8a-ad9f-272d1ad803fe',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.286179] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.288020] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.288020] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.288020] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.288020] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.288020] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.288020] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.288020] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.288020] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.288020] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.288020] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 748c6b66-3e73-44a5-8430-c76b55ad8ee3 already deleted. [ 991.288020] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-748c6b66-3e73-44a5-8430-c76b55ad8ee3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.690023] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.690023] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.690023] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.690023] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.690023] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.690023] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Segment Port 33166197-95da-4f6d-8e68-4274c6b07ee8 not found, creating... [ 991.690023] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.690023] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.690023] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.690023] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.690023] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.690714] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.690714] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.690714] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.690928] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.691150] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.691365] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Resource: SegmentPort with ID: 33166197-95da-4f6d-8e68-4274c6b07ee8 is going to be created. [ 991.713848] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.713964] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.714147] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.714379] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.716028] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.716286] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "port-33166197-95da-4f6d-8e68-4274c6b07ee8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.717909] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-34e45751-3d11-4d8a-ad9f-272d1ad803fe taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.717909] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.717909] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.717909] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.717909] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.717909] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.718446] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.718446] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.718446] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.718446] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.718446] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-34e45751-3d11-4d8a-ad9f-272d1ad803fe taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.718674] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.718674] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.718869] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.718869] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.718981] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.718981] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.719122] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.719173] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.719241] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.719322] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('34e45751-3d11-4d8a-ad9f-272d1ad803fe',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.224119] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 34e45751-3d11-4d8a-ad9f-272d1ad803fe: rpc.has_security_group_logging(os_id): False [ 992.254540] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.254762] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.254762] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.254905] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.255057] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.255337] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.255441] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.255503] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.255757] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.255851] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.256081] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.256174] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.256234] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.256373] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.256458] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.256640] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.256732] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.256808] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.256948] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.257340] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.257519] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe is going to be updated. [ 992.268755] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 in Status: SUCCESS [ 992.269087] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.269322] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.269600] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.269848] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.270127] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.270245] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.270483] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.270618] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.270750] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.270916] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b71ce0e0-83fe-4f36-8617-e29f83b0be32',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.368809] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.368809] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.368809] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.368809] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.368809] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.383664] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe in Status: IN_PROGRESS for 2s [ 992.514641] env[65471]: INFO networking_nsxv3.common.synchronization [req-8aa384b7-abf6-4135-882e-607777a4a705 req-c9e9de29-2c9d-47d1-85a5-13d5a39d3a4d service nova] Enqueued Resource ID: 748c6b66-3e73-44a5-8430-c76b55ad8ee3 with Priority: HIGHEST for action security_group_rules [ 992.514838] env[65471]: INFO networking_nsxv3.common.synchronization [req-8aa384b7-abf6-4135-882e-607777a4a705 req-c9e9de29-2c9d-47d1-85a5-13d5a39d3a4d service nova] Enqueued Resource ID: 748c6b66-3e73-44a5-8430-c76b55ad8ee3 with Priority: HIGHEST for action security_group_members [ 992.515007] env[65471]: INFO networking_nsxv3.common.synchronization [req-8aa384b7-abf6-4135-882e-607777a4a705 req-c9e9de29-2c9d-47d1-85a5-13d5a39d3a4d service nova] Enqueued Resource ID: 33166197-95da-4f6d-8e68-4274c6b07ee8 with Priority: HIGHEST for action port [ 992.516929] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 748c6b66-3e73-44a5-8430-c76b55ad8ee3 with Priority: HIGHEST for action security_group_rules [ 992.517129] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 748c6b66-3e73-44a5-8430-c76b55ad8ee3 with Priority: HIGHEST for action security_group_members [ 992.517286] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33166197-95da-4f6d-8e68-4274c6b07ee8 with Priority: HIGHEST for action port [ 992.517547] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-748c6b66-3e73-44a5-8430-c76b55ad8ee3 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.517675] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-748c6b66-3e73-44a5-8430-c76b55ad8ee3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.517985] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-748c6b66-3e73-44a5-8430-c76b55ad8ee3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.518079] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-748c6b66-3e73-44a5-8430-c76b55ad8ee3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.518183] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('748c6b66-3e73-44a5-8430-c76b55ad8ee3',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.521114] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-748c6b66-3e73-44a5-8430-c76b55ad8ee3 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.521286] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-748c6b66-3e73-44a5-8430-c76b55ad8ee3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.521359] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-748c6b66-3e73-44a5-8430-c76b55ad8ee3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.521569] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-748c6b66-3e73-44a5-8430-c76b55ad8ee3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.521787] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.521908] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.521972] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.522151] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.522236] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.522335] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('748c6b66-3e73-44a5-8430-c76b55ad8ee3',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.523323] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-33166197-95da-4f6d-8e68-4274c6b07ee8 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.523432] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-33166197-95da-4f6d-8e68-4274c6b07ee8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.523553] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-33166197-95da-4f6d-8e68-4274c6b07ee8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.523757] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-33166197-95da-4f6d-8e68-4274c6b07ee8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.523841] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33166197-95da-4f6d-8e68-4274c6b07ee8',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.774453] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b71ce0e0-83fe-4f36-8617-e29f83b0be32',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.027815] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-748c6b66-3e73-44a5-8430-c76b55ad8ee3 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.027815] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-748c6b66-3e73-44a5-8430-c76b55ad8ee3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.027815] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('748c6b66-3e73-44a5-8430-c76b55ad8ee3',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.027815] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 33166197-95da-4f6d-8e68-4274c6b07ee8 with status ACTIVE [ 993.027815] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.027815] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.027815] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.028208] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.028208] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.028208] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.028208] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.028336] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.028494] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.028494] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.031966] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.031966] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.031966] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.031966] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.031966] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.032373] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 33166197-95da-4f6d-8e68-4274c6b07ee8 is going to be updated. [ 993.067749] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.068034] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.068034] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.068192] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.068330] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.068495] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-33166197-95da-4f6d-8e68-4274c6b07ee8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.112249] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f in Status: SUCCESS [ 993.112249] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f deletion is rescheduled due to dependency. [ 993.112249] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.280310] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b71ce0e0-83fe-4f36-8617-e29f83b0be32: rpc.has_security_group_logging(os_id): False [ 993.305962] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.306068] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.306068] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.306287] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.306381] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.306656] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.306766] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.306831] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.307021] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.307105] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.307472] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 is going to be updated. [ 993.381377] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.381561] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.381621] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.381918] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.382839] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.392763] env[65471]: INFO networking_nsxv3.common.synchronization [req-a15cc4e6-b4f2-486e-8fed-23f27226dc6c req-8915332b-b672-4026-9e62-45a715953185 tempest-ServersTestJSON-569130442 tempest-ServersTestJSON-569130442-project-member] Enqueued Resource ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 with Priority: HIGHEST for action security_group_members [ 993.393271] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 with Priority: HIGHEST for action security_group_members [ 993.393669] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-735019a1-4315-46a6-b3c7-ec71fdc6ef33 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.395073] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.395073] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.395073] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.395073] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.395073] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.395073] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.395073] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.395073] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.395073] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.397187] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 in Status: IN_PROGRESS for 2s [ 993.535944] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('748c6b66-3e73-44a5-8430-c76b55ad8ee3',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.743681] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock network-92 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.743836] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "network-92" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.743961] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "network-92" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.744289] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "network-92" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.744557] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.744757] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.744907] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.745174] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.745326] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.745538] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 993.745659] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 993.745915] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 993.746053] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 993.746171] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 993.746282] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 993.746417] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 993.765859] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 993.765963] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 993.766141] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 993.766339] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "network-92" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.766656] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock port-22354c70-8413-4875-9b12-7a8a08c663ec taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.766858] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "port-22354c70-8413-4875-9b12-7a8a08c663ec" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.767090] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "port-22354c70-8413-4875-9b12-7a8a08c663ec" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.767432] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "port-22354c70-8413-4875-9b12-7a8a08c663ec" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.767570] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('22354c70-8413-4875-9b12-7a8a08c663ec',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.898707] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.040847] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.041092] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.041187] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.041324] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.041411] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.041517] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 748c6b66-3e73-44a5-8430-c76b55ad8ee3 is going to be created. [ 994.075687] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.075687] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.075901] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.076127] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.076207] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.095508] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 748c6b66-3e73-44a5-8430-c76b55ad8ee3 in Status: UNINITIALIZED for 2s [ 994.270039] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.270360] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.270455] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.271129] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.271129] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.271326] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Segment Port 22354c70-8413-4875-9b12-7a8a08c663ec not found, creating... [ 994.271491] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.271656] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.271774] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.272048] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.272280] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.272665] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.272806] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.272925] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.273174] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.273299] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.273440] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Resource: SegmentPort with ID: 22354c70-8413-4875-9b12-7a8a08c663ec is going to be created. [ 994.296361] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.296909] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.296909] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.297096] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.297622] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.298151] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "port-22354c70-8413-4875-9b12-7a8a08c663ec" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.401838] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.408910] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe in Status: SUCCESS [ 994.408910] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.906967] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.907257] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.908392] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.908392] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.908392] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.908392] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 is going to be updated. [ 994.939655] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.939933] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.939933] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.940193] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.940193] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.950616] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 in Status: IN_PROGRESS for 2s [ 995.070618] env[65471]: INFO networking_nsxv3.common.synchronization [req-a15cc4e6-b4f2-486e-8fed-23f27226dc6c req-e9bf05e3-cf56-47c4-8042-9401973aaa68 service nova] Enqueued Resource ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 with Priority: HIGHEST for action security_group_rules [ 995.070817] env[65471]: INFO networking_nsxv3.common.synchronization [req-a15cc4e6-b4f2-486e-8fed-23f27226dc6c req-e9bf05e3-cf56-47c4-8042-9401973aaa68 service nova] Enqueued Resource ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 with Priority: HIGHEST for action security_group_members [ 995.070942] env[65471]: INFO networking_nsxv3.common.synchronization [req-a15cc4e6-b4f2-486e-8fed-23f27226dc6c req-e9bf05e3-cf56-47c4-8042-9401973aaa68 service nova] Enqueued Resource ID: 22354c70-8413-4875-9b12-7a8a08c663ec with Priority: HIGHEST for action port [ 995.071577] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 with Priority: HIGHEST for action security_group_rules [ 995.071737] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 with Priority: HIGHEST for action security_group_members [ 995.071966] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22354c70-8413-4875-9b12-7a8a08c663ec with Priority: HIGHEST for action port [ 995.072631] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-735019a1-4315-46a6-b3c7-ec71fdc6ef33 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.072791] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.072881] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.073125] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.073350] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.074270] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-735019a1-4315-46a6-b3c7-ec71fdc6ef33 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.074493] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.074763] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-22354c70-8413-4875-9b12-7a8a08c663ec taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.074892] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-22354c70-8413-4875-9b12-7a8a08c663ec" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.074949] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-22354c70-8413-4875-9b12-7a8a08c663ec" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.075152] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-22354c70-8413-4875-9b12-7a8a08c663ec" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.075260] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('22354c70-8413-4875-9b12-7a8a08c663ec',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.367129] env[65471]: INFO networking_nsxv3.common.synchronization [req-1367b40f-d068-4606-b940-90b70231b3d4 req-55abdff3-1f28-4381-a4b2-89491d33d7ff tempest-MultipleCreateTestJSON-1803706331 tempest-MultipleCreateTestJSON-1803706331-project-member] Enqueued Resource ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe with Priority: HIGHEST for action security_group_members [ 995.367129] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe with Priority: HIGHEST for action security_group_members [ 995.367538] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-34e45751-3d11-4d8a-ad9f-272d1ad803fe taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.367538] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.367538] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.367773] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.367976] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.368139] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.368224] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.368408] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.368522] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.368638] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34e45751-3d11-4d8a-ad9f-272d1ad803fe',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.448337] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 in Status: SUCCESS [ 995.448707] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.577627] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-735019a1-4315-46a6-b3c7-ec71fdc6ef33 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.577764] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.577968] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 22354c70-8413-4875-9b12-7a8a08c663ec with status ACTIVE [ 995.578139] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.578245] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.578309] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.578550] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.578639] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.578808] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.578900] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.579228] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.579228] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.579228] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.579356] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.579447] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.579504] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.579645] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.579710] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.579794] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 22354c70-8413-4875-9b12-7a8a08c663ec is going to be updated. [ 995.586067] env[65471]: INFO networking_nsxv3.common.synchronization [req-7b135473-ce26-4049-978c-80b720a7e875 req-afb73fe7-776c-46fd-9b12-e170c4200611 tempest-MultipleCreateTestJSON-1803706331 tempest-MultipleCreateTestJSON-1803706331-project-member] Enqueued Resource ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe with Priority: HIGHEST for action security_group_members [ 995.587206] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe with Priority: HIGHEST for action security_group_members [ 995.588058] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-34e45751-3d11-4d8a-ad9f-272d1ad803fe taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.588058] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.609273] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.609424] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.609462] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.610096] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.610096] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.610096] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-22354c70-8413-4875-9b12-7a8a08c663ec" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.872058] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('34e45751-3d11-4d8a-ad9f-272d1ad803fe',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.106926] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 748c6b66-3e73-44a5-8430-c76b55ad8ee3 in Status: SUCCESS [ 996.107159] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-748c6b66-3e73-44a5-8430-c76b55ad8ee3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.107319] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-748c6b66-3e73-44a5-8430-c76b55ad8ee3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.107531] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-748c6b66-3e73-44a5-8430-c76b55ad8ee3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.107727] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.107841] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.107903] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.108091] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.108176] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.108260] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-748c6b66-3e73-44a5-8430-c76b55ad8ee3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.108352] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('748c6b66-3e73-44a5-8430-c76b55ad8ee3',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.380029] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('34e45751-3d11-4d8a-ad9f-272d1ad803fe',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.611231] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('748c6b66-3e73-44a5-8430-c76b55ad8ee3',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.882353] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.882572] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.882687] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.882929] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.883039] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.883138] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe is going to be updated. [ 996.936567] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.936777] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.939624] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.939624] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.939624] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.953447] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe in Status: IN_PROGRESS for 2s [ 996.963019] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 in Status: SUCCESS [ 996.963812] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.964243] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.965040] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.965040] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.965206] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.965206] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.965331] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.965422] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.965527] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.113811] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 748c6b66-3e73-44a5-8430-c76b55ad8ee3: rpc.has_security_group_logging(os_id): False [ 997.132648] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.132809] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.132870] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.133108] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.133612] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.133612] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.133612] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.133747] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.133824] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.133894] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.134006] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 748c6b66-3e73-44a5-8430-c76b55ad8ee3 is going to be created. [ 997.200203] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.200430] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.200430] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.201035] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.201035] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.234468] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 748c6b66-3e73-44a5-8430-c76b55ad8ee3 in Status: IN_PROGRESS for 2s [ 997.467727] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.973237] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.041914] env[65471]: INFO networking_nsxv3.common.synchronization [req-34894076-9087-4a4e-9fda-72d304f555e4 req-43120738-4ff1-463d-95a9-cfbe4105635a tempest-DeleteServersTestJSON-72429361 tempest-DeleteServersTestJSON-72429361-project-member] Enqueued Resource ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 with Priority: HIGHEST for action security_group_members [ 998.044278] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 with Priority: HIGHEST for action security_group_members [ 998.044278] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-c35d5123-3fe1-447f-aedc-8112e5faa2b6 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.044278] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.044278] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.044278] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.044887] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.045188] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.045366] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.046773] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.046773] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.046773] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c35d5123-3fe1-447f-aedc-8112e5faa2b6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.396144] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock network-80 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.396389] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "network-80" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.396526] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "network-80" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.396859] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "network-80" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.397173] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.397373] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.397506] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.397778] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.397942] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.398256] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 998.398318] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 998.398425] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 998.398529] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 998.398637] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 998.398808] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 998.398971] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 998.419433] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 998.419616] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 998.419713] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 998.419881] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "network-80" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.420234] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock port-0135ae2f-e8f4-4f4e-a1f3-acc0fdb0bd59 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.420408] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "port-0135ae2f-e8f4-4f4e-a1f3-acc0fdb0bd59" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.420601] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "port-0135ae2f-e8f4-4f4e-a1f3-acc0fdb0bd59" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.420947] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "port-0135ae2f-e8f4-4f4e-a1f3-acc0fdb0bd59" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.421096] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0135ae2f-e8f4-4f4e-a1f3-acc0fdb0bd59',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.476638] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.477030] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.477030] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.477108] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.477141] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.477246] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 is going to be updated. [ 998.504422] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.504595] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.504634] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.504814] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.504974] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.515954] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 in Status: IN_PROGRESS for 2s [ 998.548151] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.548390] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.548390] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.548580] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.548671] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.548863] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.548961] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.549042] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.549192] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.549267] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.549355] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 is going to be updated. [ 998.577943] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.579797] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.579797] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.579797] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.579797] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.588403] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 in Status: IN_PROGRESS for 2s [ 998.925367] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.925367] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.925367] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.925367] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.925367] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.925367] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Segment Port 0135ae2f-e8f4-4f4e-a1f3-acc0fdb0bd59 not found, creating... [ 998.925367] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.925686] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.925686] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.926011] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.926011] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.926286] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.926435] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.926546] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.926754] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.926878] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.927020] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Resource: SegmentPort with ID: 0135ae2f-e8f4-4f4e-a1f3-acc0fdb0bd59 is going to be created. [ 998.950447] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.950691] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.950841] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.951085] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.951320] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.951540] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "port-0135ae2f-e8f4-4f4e-a1f3-acc0fdb0bd59" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.962975] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe in Status: SUCCESS [ 998.963217] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.963378] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.963586] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.963819] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.963896] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.963973] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.964159] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.964240] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.964334] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34e45751-3d11-4d8a-ad9f-272d1ad803fe',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.248374] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 748c6b66-3e73-44a5-8430-c76b55ad8ee3 in Status: SUCCESS [ 999.248757] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-748c6b66-3e73-44a5-8430-c76b55ad8ee3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.466701] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.466953] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.467097] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.467423] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.467587] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.467926] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.468093] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.468214] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.468477] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.468639] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.468793] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe is going to be updated. [ 999.496517] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.496925] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.496925] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.497088] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.497180] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.507201] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe in Status: IN_PROGRESS for 2s [ 999.720926] env[65471]: INFO networking_nsxv3.common.synchronization [req-34894076-9087-4a4e-9fda-72d304f555e4 req-3833ef27-fec5-4698-be49-b441933ee60a service nova] Enqueued Resource ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 with Priority: HIGHEST for action security_group_rules [ 999.721870] env[65471]: INFO networking_nsxv3.common.synchronization [req-34894076-9087-4a4e-9fda-72d304f555e4 req-3833ef27-fec5-4698-be49-b441933ee60a service nova] Enqueued Resource ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 with Priority: HIGHEST for action security_group_members [ 999.721870] env[65471]: INFO networking_nsxv3.common.synchronization [req-34894076-9087-4a4e-9fda-72d304f555e4 req-3833ef27-fec5-4698-be49-b441933ee60a service nova] Enqueued Resource ID: 0135ae2f-e8f4-4f4e-a1f3-acc0fdb0bd59 with Priority: HIGHEST for action port [ 999.721870] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 with Priority: HIGHEST for action security_group_rules [ 999.722104] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 with Priority: HIGHEST for action security_group_members [ 999.722718] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0135ae2f-e8f4-4f4e-a1f3-acc0fdb0bd59 with Priority: HIGHEST for action port [ 999.722718] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c35d5123-3fe1-447f-aedc-8112e5faa2b6 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.722718] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.722718] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.723202] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.723202] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c35d5123-3fe1-447f-aedc-8112e5faa2b6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.724627] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-c35d5123-3fe1-447f-aedc-8112e5faa2b6 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.724875] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.725071] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-0135ae2f-e8f4-4f4e-a1f3-acc0fdb0bd59 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.725071] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0135ae2f-e8f4-4f4e-a1f3-acc0fdb0bd59" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.725269] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0135ae2f-e8f4-4f4e-a1f3-acc0fdb0bd59" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.725356] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0135ae2f-e8f4-4f4e-a1f3-acc0fdb0bd59" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.726232] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0135ae2f-e8f4-4f4e-a1f3-acc0fdb0bd59',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.229040] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-c35d5123-3fe1-447f-aedc-8112e5faa2b6 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.229222] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.229387] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0135ae2f-e8f4-4f4e-a1f3-acc0fdb0bd59 with status ACTIVE [ 1000.229559] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.229668] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.229731] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.229950] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.230052] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.230259] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.230337] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.230399] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.230555] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.230644] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.230826] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.230917] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.230977] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.231137] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.231210] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.231293] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0135ae2f-e8f4-4f4e-a1f3-acc0fdb0bd59 is going to be updated. [ 1000.255605] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.255740] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.255818] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.256020] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.256159] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.256327] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0135ae2f-e8f4-4f4e-a1f3-acc0fdb0bd59" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.528270] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 in Status: SUCCESS [ 1000.528646] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.528778] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.529064] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.529302] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.530047] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.530047] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.530047] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.530047] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.530047] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.530047] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.599527] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 in Status: SUCCESS [ 1000.599808] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 deletion is rescheduled due to dependency. [ 1000.599892] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.600053] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.600312] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.600588] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.600727] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.600727] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.600842] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.600931] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.601039] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c35d5123-3fe1-447f-aedc-8112e5faa2b6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.033093] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-735019a1-4315-46a6-b3c7-ec71fdc6ef33 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.033213] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.033254] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.033483] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.033687] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.033800] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.033867] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.034034] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.034121] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.034218] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.034361] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-735019a1-4315-46a6-b3c7-ec71fdc6ef33 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.034459] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.034519] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.034653] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.034807] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.034904] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.034965] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.035125] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.035199] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.035275] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.035363] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.103841] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c35d5123-3fe1-447f-aedc-8112e5faa2b6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.521465] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe in Status: SUCCESS [ 1001.521733] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe deletion is rescheduled due to dependency. [ 1001.521895] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.537585] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 735019a1-4315-46a6-b3c7-ec71fdc6ef33: rpc.has_security_group_logging(os_id): False [ 1001.557482] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.557653] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.557771] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.558055] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.558557] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.558869] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.559021] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.559114] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.559358] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.559464] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.559728] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.559862] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.559951] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.560158] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.560261] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.560535] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.560661] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.560753] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.560975] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.561070] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.561188] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 is going to be updated. [ 1001.605513] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c35d5123-3fe1-447f-aedc-8112e5faa2b6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.625144] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.625144] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.625144] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.625435] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.625510] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.638536] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 in Status: IN_PROGRESS for 2s [ 1002.108545] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.108897] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.109075] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.109380] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.110485] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.110606] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 is going to be updated. [ 1002.146405] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.146405] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.146405] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.146658] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.146768] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.156100] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 in Status: IN_PROGRESS for 2s [ 1003.656678] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 in Status: SUCCESS [ 1003.656962] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.171968] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 in Status: SUCCESS [ 1004.171968] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.171968] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.171968] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.172184] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.172184] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.172289] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.172647] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.172647] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.172647] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.172837] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c35d5123-3fe1-447f-aedc-8112e5faa2b6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.675661] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-c35d5123-3fe1-447f-aedc-8112e5faa2b6 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.675661] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.675661] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.676121] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.676249] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.676379] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.676448] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.676608] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.676698] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.676783] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.676934] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-c35d5123-3fe1-447f-aedc-8112e5faa2b6 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.677094] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.677137] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.677268] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.677402] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.677493] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.677552] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.677683] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.677757] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.677835] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.677922] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c35d5123-3fe1-447f-aedc-8112e5faa2b6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.723581] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1004.723815] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1005.179884] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c35d5123-3fe1-447f-aedc-8112e5faa2b6: rpc.has_security_group_logging(os_id): False [ 1005.201251] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.201251] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.201251] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.201251] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.201251] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.201251] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.201251] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.201251] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.201251] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.201251] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.201688] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.201688] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.201688] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.201688] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.201826] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.201917] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.202015] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.202074] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.202210] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.202276] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.202357] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 is going to be updated. [ 1005.270156] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.270410] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.270410] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.270740] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.270927] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.285927] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 in Status: IN_PROGRESS for 2s [ 1005.904279] env[65471]: INFO networking_nsxv3.common.synchronization [req-6c821047-1037-4832-a568-3cbae6d0f7c4 req-1a50bc58-6418-49f3-afb4-2fe995d40588 tempest-ServerRescueNegativeTestJSON-1570103274 tempest-ServerRescueNegativeTestJSON-1570103274-project-member] Enqueued Resource ID: 2e3bdef3-6800-4bd2-84b8-3ef120fd62f1 with Priority: HIGHEST for action security_group_members [ 1005.904944] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e3bdef3-6800-4bd2-84b8-3ef120fd62f1 with Priority: HIGHEST for action security_group_members [ 1005.905345] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.905472] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.905541] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.905796] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.905965] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.906082] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.906157] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.906320] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.906404] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.906501] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e3bdef3-6800-4bd2-84b8-3ef120fd62f1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.200730] env[65471]: INFO networking_nsxv3.common.synchronization [req-3a849a47-7972-4cda-ba9c-0782792e34e9 req-9209ec99-f82c-4ffc-b47c-85671449f7f1 tempest-ServersTestJSON-569130442 tempest-ServersTestJSON-569130442-project-member] Enqueued Resource ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 with Priority: HIGHEST for action security_group_members [ 1006.201407] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 with Priority: HIGHEST for action security_group_members [ 1006.201751] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-735019a1-4315-46a6-b3c7-ec71fdc6ef33 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.201871] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.201955] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.202168] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.202333] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.202438] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.202502] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.202670] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.202754] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.202852] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.283783] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock network-72 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.284010] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "network-72" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.284142] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "network-72" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.284478] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "network-72" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.285518] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.285518] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.285518] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.285518] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.285518] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.286129] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1006.286129] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1006.286129] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1006.286129] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1006.286129] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1006.286129] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1006.286423] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1006.409672] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.409672] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.409831] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.410107] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.410267] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.410596] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.410743] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.410811] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.410986] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.411084] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.411175] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e3bdef3-6800-4bd2-84b8-3ef120fd62f1 already deleted. [ 1006.411255] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.505052] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1006.505052] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Cache value generated in 0.218 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1006.505052] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1006.505052] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "network-72" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.505307] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock port-8962ea0d-1f88-4ab8-993c-9452714e2f77 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.506514] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "port-8962ea0d-1f88-4ab8-993c-9452714e2f77" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.506514] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "port-8962ea0d-1f88-4ab8-993c-9452714e2f77" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.506514] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "port-8962ea0d-1f88-4ab8-993c-9452714e2f77" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.506514] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8962ea0d-1f88-4ab8-993c-9452714e2f77',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.705072] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.009990] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.010378] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.010462] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.010786] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.010978] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.011203] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Segment Port 8962ea0d-1f88-4ab8-993c-9452714e2f77 not found, creating... [ 1007.011506] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.011730] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.011855] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.012106] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.012240] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.012523] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.012728] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.012844] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.013063] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.013195] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.013331] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Resource: SegmentPort with ID: 8962ea0d-1f88-4ab8-993c-9452714e2f77 is going to be created. [ 1007.033192] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.033604] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.033604] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.033802] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.034040] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.034272] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "port-8962ea0d-1f88-4ab8-993c-9452714e2f77" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.208010] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.307516] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 in Status: SUCCESS [ 1007.308106] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.571427] env[65471]: INFO networking_nsxv3.common.synchronization [req-6c821047-1037-4832-a568-3cbae6d0f7c4 req-64bf27f8-4f01-4bd6-95aa-b1d11df13f23 service nova] Enqueued Resource ID: 2e3bdef3-6800-4bd2-84b8-3ef120fd62f1 with Priority: HIGHEST for action security_group_rules [ 1007.571587] env[65471]: INFO networking_nsxv3.common.synchronization [req-6c821047-1037-4832-a568-3cbae6d0f7c4 req-64bf27f8-4f01-4bd6-95aa-b1d11df13f23 service nova] Enqueued Resource ID: 2e3bdef3-6800-4bd2-84b8-3ef120fd62f1 with Priority: HIGHEST for action security_group_members [ 1007.571887] env[65471]: INFO networking_nsxv3.common.synchronization [req-6c821047-1037-4832-a568-3cbae6d0f7c4 req-64bf27f8-4f01-4bd6-95aa-b1d11df13f23 service nova] Enqueued Resource ID: 8962ea0d-1f88-4ab8-993c-9452714e2f77 with Priority: HIGHEST for action port [ 1007.572537] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e3bdef3-6800-4bd2-84b8-3ef120fd62f1 with Priority: HIGHEST for action security_group_rules [ 1007.572781] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e3bdef3-6800-4bd2-84b8-3ef120fd62f1 with Priority: HIGHEST for action security_group_members [ 1007.572836] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8962ea0d-1f88-4ab8-993c-9452714e2f77 with Priority: HIGHEST for action port [ 1007.573165] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.573292] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.573359] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.573648] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.573773] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2e3bdef3-6800-4bd2-84b8-3ef120fd62f1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.574622] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.574728] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.574796] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.574960] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.575118] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.575231] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.575294] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.575548] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.575660] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.575808] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e3bdef3-6800-4bd2-84b8-3ef120fd62f1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.576701] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-8962ea0d-1f88-4ab8-993c-9452714e2f77 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.576776] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8962ea0d-1f88-4ab8-993c-9452714e2f77" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.576871] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8962ea0d-1f88-4ab8-993c-9452714e2f77" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.577037] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8962ea0d-1f88-4ab8-993c-9452714e2f77" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.577117] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8962ea0d-1f88-4ab8-993c-9452714e2f77',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.710492] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.710727] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.710798] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.711037] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.711133] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.711240] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 is going to be updated. [ 1007.743734] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.743734] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.743910] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.744042] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.744132] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.753351] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 in Status: IN_PROGRESS for 2s [ 1008.080125] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.080125] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.080125] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2e3bdef3-6800-4bd2-84b8-3ef120fd62f1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.080691] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8962ea0d-1f88-4ab8-993c-9452714e2f77 with status ACTIVE [ 1008.080838] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.080955] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.081034] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.081246] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.081336] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.081509] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.081603] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.081665] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.081812] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.081900] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.082137] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.082207] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.082244] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.082362] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.082435] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.082519] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8962ea0d-1f88-4ab8-993c-9452714e2f77 is going to be updated. [ 1008.109639] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.109828] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.109828] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.110062] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.110194] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.110358] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8962ea0d-1f88-4ab8-993c-9452714e2f77" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.400493] env[65471]: INFO networking_nsxv3.common.synchronization [req-2365ee61-bfa8-4831-b841-de7040f62773 req-562cff98-933a-44e0-b1fd-1b71f00e787f tempest-ServerRescueNegativeTestJSON-1570103274 tempest-ServerRescueNegativeTestJSON-1570103274-project-member] Enqueued Resource ID: 2e3bdef3-6800-4bd2-84b8-3ef120fd62f1 with Priority: HIGHEST for action security_group_members [ 1008.400751] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e3bdef3-6800-4bd2-84b8-3ef120fd62f1 with Priority: HIGHEST for action security_group_members [ 1008.401167] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.401273] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.585036] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2e3bdef3-6800-4bd2-84b8-3ef120fd62f1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.761360] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock network-72 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.761538] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "network-72" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.761666] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "network-72" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.761943] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "network-72" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.762731] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.762731] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.762731] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.762731] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.762967] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.763149] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1008.763269] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1008.763391] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1008.763497] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1008.763603] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1008.763705] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1008.763855] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1008.784530] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1008.784722] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1008.784867] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1008.785065] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "network-72" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.785385] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock port-c37a00c2-886d-4423-bc88-8f89a01c8203 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.785962] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "port-c37a00c2-886d-4423-bc88-8f89a01c8203" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.786090] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "port-c37a00c2-886d-4423-bc88-8f89a01c8203" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.786380] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "port-c37a00c2-886d-4423-bc88-8f89a01c8203" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.786517] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c37a00c2-886d-4423-bc88-8f89a01c8203',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.087860] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.088289] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.088289] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.088367] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.088425] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.088566] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e3bdef3-6800-4bd2-84b8-3ef120fd62f1 is going to be created. [ 1009.114821] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.115019] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.115068] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.115254] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.115410] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.125504] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e3bdef3-6800-4bd2-84b8-3ef120fd62f1 in Status: UNINITIALIZED for 2s [ 1009.292270] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.292270] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.292270] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.292270] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.292270] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.292270] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Segment Port c37a00c2-886d-4423-bc88-8f89a01c8203 not found, creating... [ 1009.292270] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.292270] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.292270] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.292270] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.292270] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.292982] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.293181] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.293304] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.293535] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.293756] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.293909] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Resource: SegmentPort with ID: c37a00c2-886d-4423-bc88-8f89a01c8203 is going to be created. [ 1009.344286] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.344527] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.344806] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.344940] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.345169] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.345407] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "port-c37a00c2-886d-4423-bc88-8f89a01c8203" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.763331] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 in Status: SUCCESS [ 1009.763558] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.081309] env[65471]: INFO networking_nsxv3.common.synchronization [req-2365ee61-bfa8-4831-b841-de7040f62773 req-89648c69-042e-4b25-a4d2-407799c6ffa5 service nova] Enqueued Resource ID: 2e3bdef3-6800-4bd2-84b8-3ef120fd62f1 with Priority: HIGHEST for action security_group_rules [ 1010.087021] env[65471]: INFO networking_nsxv3.common.synchronization [req-2365ee61-bfa8-4831-b841-de7040f62773 req-89648c69-042e-4b25-a4d2-407799c6ffa5 service nova] Enqueued Resource ID: 2e3bdef3-6800-4bd2-84b8-3ef120fd62f1 with Priority: HIGHEST for action security_group_members [ 1010.087021] env[65471]: INFO networking_nsxv3.common.synchronization [req-2365ee61-bfa8-4831-b841-de7040f62773 req-89648c69-042e-4b25-a4d2-407799c6ffa5 service nova] Enqueued Resource ID: c37a00c2-886d-4423-bc88-8f89a01c8203 with Priority: HIGHEST for action port [ 1010.087021] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e3bdef3-6800-4bd2-84b8-3ef120fd62f1 with Priority: HIGHEST for action security_group_rules [ 1010.087021] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e3bdef3-6800-4bd2-84b8-3ef120fd62f1 with Priority: HIGHEST for action security_group_members [ 1010.087021] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c37a00c2-886d-4423-bc88-8f89a01c8203 with Priority: HIGHEST for action port [ 1010.087021] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.087021] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.087021] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.087021] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.087021] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-c37a00c2-886d-4423-bc88-8f89a01c8203 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.087021] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c37a00c2-886d-4423-bc88-8f89a01c8203" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.087021] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c37a00c2-886d-4423-bc88-8f89a01c8203" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.087021] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c37a00c2-886d-4423-bc88-8f89a01c8203" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.087021] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c37a00c2-886d-4423-bc88-8f89a01c8203',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.587789] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c37a00c2-886d-4423-bc88-8f89a01c8203 with status ACTIVE [ 1010.588111] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.588207] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.588256] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.588581] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.588662] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.588948] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.589072] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.589154] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.589278] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.589347] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.589536] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.589617] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.589679] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.589817] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.589924] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.589970] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c37a00c2-886d-4423-bc88-8f89a01c8203 is going to be updated. [ 1010.615576] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.615576] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.615576] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.615576] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.616020] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.616020] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c37a00c2-886d-4423-bc88-8f89a01c8203" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.887267] env[65471]: INFO networking_nsxv3.common.synchronization [req-9e837f9a-bb6e-4450-9504-5645aec83a6d req-39947cd8-8398-413f-83a0-4e4895545664 tempest-ServersTestMultiNic-44021310 tempest-ServersTestMultiNic-44021310-project-member] Enqueued Resource ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea with Priority: HIGHEST for action security_group_members [ 1010.887697] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea with Priority: HIGHEST for action security_group_members [ 1010.888442] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.888442] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.888442] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.888442] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.888659] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.888659] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.888659] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.888785] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.888872] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.888963] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('918bf7c8-0ca6-4052-a0a9-38a8db5664ea',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.138376] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e3bdef3-6800-4bd2-84b8-3ef120fd62f1 in Status: SUCCESS [ 1011.138870] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.138994] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.139344] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.139652] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.139875] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.140080] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.140288] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.140395] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.140507] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.140701] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2e3bdef3-6800-4bd2-84b8-3ef120fd62f1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.141677] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.142698] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.142698] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.142698] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.142698] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.142698] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.142698] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.142698] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e3bdef3-6800-4bd2-84b8-3ef120fd62f1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.176600] env[65471]: INFO networking_nsxv3.common.synchronization [req-9e837f9a-bb6e-4450-9504-5645aec83a6d req-36674057-699c-43fc-8dca-8e734e2e9562 tempest-ServersTestMultiNic-44021310 tempest-ServersTestMultiNic-44021310-project-member] Enqueued Resource ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea with Priority: HIGHEST for action security_group_members [ 1011.177622] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea with Priority: HIGHEST for action security_group_members [ 1011.178371] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.178371] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.392963] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.392963] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.392963] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.392963] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.394673] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.394673] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.394673] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.394673] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.394673] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.394673] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.394673] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea is going to be updated. [ 1011.428867] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.429098] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.429098] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.429313] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.429458] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.446991] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea in Status: IN_PROGRESS for 2s [ 1011.506262] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock network-581 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.506485] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "network-581" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.506620] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "network-581" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.507064] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "network-581" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.507367] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.507532] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.507667] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.507913] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.508094] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.508329] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1011.508446] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1011.508560] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1011.508679] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1011.508796] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1011.508919] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1011.509078] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1011.529580] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1011.529751] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1011.529912] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1011.530118] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "network-581" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.530547] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock port-fcf2dab2-6493-49ae-b52f-7de7ca231b38 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.530780] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "port-fcf2dab2-6493-49ae-b52f-7de7ca231b38" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.530914] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "port-fcf2dab2-6493-49ae-b52f-7de7ca231b38" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.531390] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "port-fcf2dab2-6493-49ae-b52f-7de7ca231b38" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.531390] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fcf2dab2-6493-49ae-b52f-7de7ca231b38',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.644444] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.644772] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.644842] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2e3bdef3-6800-4bd2-84b8-3ef120fd62f1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.034051] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.034051] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.034051] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.034303] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.034397] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.034542] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Segment Port fcf2dab2-6493-49ae-b52f-7de7ca231b38 not found, creating... [ 1012.034793] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.034948] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.035078] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.035291] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.035425] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.035717] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.035943] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.036032] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.036400] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.036556] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.036737] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Resource: SegmentPort with ID: fcf2dab2-6493-49ae-b52f-7de7ca231b38 is going to be created. [ 1012.059305] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.059611] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.059762] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.060117] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.060403] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.061042] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "port-fcf2dab2-6493-49ae-b52f-7de7ca231b38" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.147184] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2e3bdef3-6800-4bd2-84b8-3ef120fd62f1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.650055] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.650055] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.650055] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.650448] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.650448] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.650509] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e3bdef3-6800-4bd2-84b8-3ef120fd62f1 is going to be updated. [ 1012.691148] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.691371] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.691371] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.692048] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.692048] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.701215] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e3bdef3-6800-4bd2-84b8-3ef120fd62f1 in Status: IN_PROGRESS for 2s [ 1012.782949] env[65471]: INFO networking_nsxv3.common.synchronization [req-9e837f9a-bb6e-4450-9504-5645aec83a6d req-73ef84f9-434e-424f-886f-98894b30996a service nova] Enqueued Resource ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea with Priority: HIGHEST for action security_group_rules [ 1012.783104] env[65471]: INFO networking_nsxv3.common.synchronization [req-9e837f9a-bb6e-4450-9504-5645aec83a6d req-73ef84f9-434e-424f-886f-98894b30996a service nova] Enqueued Resource ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea with Priority: HIGHEST for action security_group_members [ 1012.783241] env[65471]: INFO networking_nsxv3.common.synchronization [req-9e837f9a-bb6e-4450-9504-5645aec83a6d req-73ef84f9-434e-424f-886f-98894b30996a service nova] Enqueued Resource ID: fcf2dab2-6493-49ae-b52f-7de7ca231b38 with Priority: HIGHEST for action port [ 1012.783795] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea with Priority: HIGHEST for action security_group_rules [ 1012.783933] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea with Priority: HIGHEST for action security_group_members [ 1012.784045] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcf2dab2-6493-49ae-b52f-7de7ca231b38 with Priority: HIGHEST for action port [ 1012.784352] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-918bf7c8-0ca6-4052-a0a9-38a8db5664ea taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.784566] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.784566] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.785173] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.785173] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('918bf7c8-0ca6-4052-a0a9-38a8db5664ea',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.785702] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.785798] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.785995] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-fcf2dab2-6493-49ae-b52f-7de7ca231b38 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.786126] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fcf2dab2-6493-49ae-b52f-7de7ca231b38" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.787035] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fcf2dab2-6493-49ae-b52f-7de7ca231b38" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.787035] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fcf2dab2-6493-49ae-b52f-7de7ca231b38" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.787035] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fcf2dab2-6493-49ae-b52f-7de7ca231b38',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.289413] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.289413] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.289602] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fcf2dab2-6493-49ae-b52f-7de7ca231b38 with status ACTIVE [ 1013.289714] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.289824] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.289933] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.290120] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.290216] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.290404] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.290499] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.290618] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.290789] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.290868] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.291063] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.291154] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.291212] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.291348] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.291452] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.291506] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fcf2dab2-6493-49ae-b52f-7de7ca231b38 is going to be updated. [ 1013.327070] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.327371] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.327371] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.327583] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.327980] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.327980] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fcf2dab2-6493-49ae-b52f-7de7ca231b38" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.463614] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea in Status: SUCCESS [ 1013.464586] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea deletion is rescheduled due to dependency. [ 1013.464586] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.464586] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.464586] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.464827] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.464942] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.465029] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.465415] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.465415] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.465415] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('918bf7c8-0ca6-4052-a0a9-38a8db5664ea',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.567937] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock network-207 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.568169] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "network-207" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.568272] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "network-207" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.568602] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "network-207" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.568864] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.569043] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.569165] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.569692] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.569692] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.569978] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1013.570154] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1013.570270] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1013.570381] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1013.570492] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1013.570597] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1013.570777] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1013.591804] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1013.591982] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1013.592117] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1013.592292] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "network-207" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.592597] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock port-521d8dad-7cc6-4213-95b3-4684a5230b1b taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.592791] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "port-521d8dad-7cc6-4213-95b3-4684a5230b1b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.592913] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "port-521d8dad-7cc6-4213-95b3-4684a5230b1b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.593269] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "port-521d8dad-7cc6-4213-95b3-4684a5230b1b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.593411] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('521d8dad-7cc6-4213-95b3-4684a5230b1b',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.967947] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('918bf7c8-0ca6-4052-a0a9-38a8db5664ea',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.096244] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.096524] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.096649] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.096941] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.097116] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.097272] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Segment Port 521d8dad-7cc6-4213-95b3-4684a5230b1b not found, creating... [ 1014.097563] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.097797] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.097797] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.098041] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.098240] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.098475] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.098645] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.098722] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.098947] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.099078] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.099225] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Resource: SegmentPort with ID: 521d8dad-7cc6-4213-95b3-4684a5230b1b is going to be created. [ 1014.127703] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.127895] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.127895] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.128174] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.128580] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.128631] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "port-521d8dad-7cc6-4213-95b3-4684a5230b1b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.471295] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('918bf7c8-0ca6-4052-a0a9-38a8db5664ea',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.714020] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e3bdef3-6800-4bd2-84b8-3ef120fd62f1 in Status: SUCCESS [ 1014.714020] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.714020] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.714020] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.714020] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.714020] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.714020] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.714020] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.714020] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.714020] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e3bdef3-6800-4bd2-84b8-3ef120fd62f1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.841224] env[65471]: INFO networking_nsxv3.common.synchronization [req-9e837f9a-bb6e-4450-9504-5645aec83a6d req-e7807c50-3520-4495-a9a6-47b08ec29111 service nova] Enqueued Resource ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea with Priority: HIGHEST for action security_group_rules [ 1014.841224] env[65471]: INFO networking_nsxv3.common.synchronization [req-9e837f9a-bb6e-4450-9504-5645aec83a6d req-e7807c50-3520-4495-a9a6-47b08ec29111 service nova] Enqueued Resource ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea with Priority: HIGHEST for action security_group_members [ 1014.841224] env[65471]: INFO networking_nsxv3.common.synchronization [req-9e837f9a-bb6e-4450-9504-5645aec83a6d req-e7807c50-3520-4495-a9a6-47b08ec29111 service nova] Enqueued Resource ID: 521d8dad-7cc6-4213-95b3-4684a5230b1b with Priority: HIGHEST for action port [ 1014.841224] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea with Priority: HIGHEST for action security_group_rules [ 1014.841224] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea with Priority: HIGHEST for action security_group_members [ 1014.841224] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 521d8dad-7cc6-4213-95b3-4684a5230b1b with Priority: HIGHEST for action port [ 1014.841224] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-918bf7c8-0ca6-4052-a0a9-38a8db5664ea taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.841224] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.844306] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.844816] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.845535] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-521d8dad-7cc6-4213-95b3-4684a5230b1b taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.845810] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-521d8dad-7cc6-4213-95b3-4684a5230b1b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.845977] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-521d8dad-7cc6-4213-95b3-4684a5230b1b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.846286] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-521d8dad-7cc6-4213-95b3-4684a5230b1b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.846454] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('521d8dad-7cc6-4213-95b3-4684a5230b1b',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.975119] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.975119] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.975119] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.975119] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.975119] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.975119] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea is going to be updated. [ 1015.007918] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.007918] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.008105] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.011021] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.011021] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.018269] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea in Status: IN_PROGRESS for 2s [ 1015.215564] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2e3bdef3-6800-4bd2-84b8-3ef120fd62f1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.349311] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 521d8dad-7cc6-4213-95b3-4684a5230b1b with status ACTIVE [ 1015.349539] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.349853] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.349853] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.350098] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.350192] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.350938] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.350938] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.350938] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.350938] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.350938] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.350938] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.351334] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.351334] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.351334] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.351334] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.351468] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 521d8dad-7cc6-4213-95b3-4684a5230b1b is going to be updated. [ 1015.376675] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.376833] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.376900] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.377208] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.377352] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.377514] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-521d8dad-7cc6-4213-95b3-4684a5230b1b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.543506] env[65471]: INFO networking_nsxv3.common.synchronization [req-71db89fc-3a84-4bac-ac16-5a5f881f49f0 req-6251f5c4-31c7-4396-9ec6-aaf309dd526a tempest-ServerDiskConfigTestJSON-1443816332 tempest-ServerDiskConfigTestJSON-1443816332-project-member] Enqueued Resource ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e with Priority: HIGHEST for action security_group_members [ 1015.543608] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e with Priority: HIGHEST for action security_group_members [ 1015.548171] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.548171] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.548171] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.548171] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.548171] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.548171] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.548171] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.548171] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.548171] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.548171] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c8a6eda-c0ec-4e25-8652-6acf3d57da4e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.717846] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2e3bdef3-6800-4bd2-84b8-3ef120fd62f1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.938014] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock network-537 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.938227] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "network-537" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.938354] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "network-537" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.938626] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "network-537" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.938881] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.939045] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.939161] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.939381] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.939522] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.939732] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1015.939842] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1015.939943] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1015.940057] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1015.940163] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1015.940306] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1015.940389] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1015.962255] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1015.962255] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1015.962255] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1015.962255] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "network-537" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.962255] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock port-465388e7-8351-4631-94b1-fef018c6d454 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.962255] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "port-465388e7-8351-4631-94b1-fef018c6d454" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.962255] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "port-465388e7-8351-4631-94b1-fef018c6d454" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.962556] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "port-465388e7-8351-4631-94b1-fef018c6d454" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.963108] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('465388e7-8351-4631-94b1-fef018c6d454',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.053057] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.053386] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.053386] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.053519] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.053610] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.053841] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.053963] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.054100] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.054311] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.054414] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.054526] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e is going to be updated. [ 1016.081249] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.081429] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.081494] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.085131] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.085343] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.094648] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e in Status: IN_PROGRESS for 2s [ 1016.221113] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.221362] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.221465] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.221790] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.221907] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.222079] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e3bdef3-6800-4bd2-84b8-3ef120fd62f1 is going to be updated. [ 1016.253617] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.253757] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.253885] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.254089] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.254263] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.262667] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e3bdef3-6800-4bd2-84b8-3ef120fd62f1 in Status: IN_PROGRESS for 2s [ 1016.466305] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.466305] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.466305] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.466587] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.466631] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.466763] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Segment Port 465388e7-8351-4631-94b1-fef018c6d454 not found, creating... [ 1016.467405] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.467405] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.467405] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.467598] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.467721] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.467993] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.468157] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.468274] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.468479] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.468609] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.468745] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Resource: SegmentPort with ID: 465388e7-8351-4631-94b1-fef018c6d454 is going to be created. [ 1016.489968] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.490205] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.491031] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.491031] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.491031] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.491031] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "port-465388e7-8351-4631-94b1-fef018c6d454" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.028858] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea in Status: SUCCESS [ 1017.029229] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.029312] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.029563] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.029782] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.029914] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.030253] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.030253] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.030253] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.030392] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('918bf7c8-0ca6-4052-a0a9-38a8db5664ea',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.247552] env[65471]: INFO networking_nsxv3.common.synchronization [req-71db89fc-3a84-4bac-ac16-5a5f881f49f0 req-956e2908-7979-4bd6-80e1-2925a5825a24 service nova] Enqueued Resource ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e with Priority: HIGHEST for action security_group_rules [ 1017.248115] env[65471]: INFO networking_nsxv3.common.synchronization [req-71db89fc-3a84-4bac-ac16-5a5f881f49f0 req-956e2908-7979-4bd6-80e1-2925a5825a24 service nova] Enqueued Resource ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e with Priority: HIGHEST for action security_group_members [ 1017.248357] env[65471]: INFO networking_nsxv3.common.synchronization [req-71db89fc-3a84-4bac-ac16-5a5f881f49f0 req-956e2908-7979-4bd6-80e1-2925a5825a24 service nova] Enqueued Resource ID: 465388e7-8351-4631-94b1-fef018c6d454 with Priority: HIGHEST for action port [ 1017.249058] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e with Priority: HIGHEST for action security_group_rules [ 1017.249273] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e with Priority: HIGHEST for action security_group_members [ 1017.249454] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 465388e7-8351-4631-94b1-fef018c6d454 with Priority: HIGHEST for action port [ 1017.249822] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.249991] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.250087] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.250353] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.250461] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1c8a6eda-c0ec-4e25-8652-6acf3d57da4e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.251615] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.251739] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.252052] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-465388e7-8351-4631-94b1-fef018c6d454 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.252202] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-465388e7-8351-4631-94b1-fef018c6d454" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.252333] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-465388e7-8351-4631-94b1-fef018c6d454" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.252564] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-465388e7-8351-4631-94b1-fef018c6d454" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.252636] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('465388e7-8351-4631-94b1-fef018c6d454',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.370339] env[65471]: INFO networking_nsxv3.common.synchronization [req-61a64318-27a0-4d82-872a-b73ab4c4ee70 req-f042216c-1655-4102-a553-b64bcb140f03 tempest-AttachInterfacesTestJSON-1197806586 tempest-AttachInterfacesTestJSON-1197806586-project-member] Enqueued Resource ID: e8869e0a-9385-48b2-ac90-589c8415df21 with Priority: HIGHEST for action security_group_members [ 1017.371074] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8869e0a-9385-48b2-ac90-589c8415df21 with Priority: HIGHEST for action security_group_members [ 1017.371420] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8869e0a-9385-48b2-ac90-589c8415df21 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.371548] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.371616] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.372625] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.372898] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.373034] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.373105] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.373290] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.373379] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.373640] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e8869e0a-9385-48b2-ac90-589c8415df21',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.534033] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('918bf7c8-0ca6-4052-a0a9-38a8db5664ea',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.723746] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock network-238 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.724019] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "network-238" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.724177] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "network-238" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.725028] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "network-238" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.725028] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.725028] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.725246] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.725318] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.725461] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.725831] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1017.725831] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1017.726207] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1017.726207] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1017.726207] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1017.726207] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1017.726395] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1017.746265] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1017.746265] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1017.746475] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1017.746475] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "network-238" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.746781] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock port-246df3cd-0d4c-4d2a-8b50-11c3e4a5e226 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.746945] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "port-246df3cd-0d4c-4d2a-8b50-11c3e4a5e226" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.747071] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "port-246df3cd-0d4c-4d2a-8b50-11c3e4a5e226" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.747395] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "port-246df3cd-0d4c-4d2a-8b50-11c3e4a5e226" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.747528] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('246df3cd-0d4c-4d2a-8b50-11c3e4a5e226',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.755234] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.755362] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.755538] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 465388e7-8351-4631-94b1-fef018c6d454 with status ACTIVE [ 1017.755719] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.756631] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.756631] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.756631] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.756631] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.756631] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.756631] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.756631] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.757042] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.757042] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.757042] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.757042] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.757270] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.757270] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.757337] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.757389] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 465388e7-8351-4631-94b1-fef018c6d454 is going to be updated. [ 1017.778352] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.778545] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.778545] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.778711] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.778899] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.779119] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-465388e7-8351-4631-94b1-fef018c6d454" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.877638] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.877638] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.877638] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.878040] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.878132] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.878358] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.878471] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.878531] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.878702] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.878784] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.878894] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8869e0a-9385-48b2-ac90-589c8415df21 is going to be updated. [ 1017.906654] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.906875] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.906875] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.907016] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.907159] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.917663] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8869e0a-9385-48b2-ac90-589c8415df21 in Status: IN_PROGRESS for 2s [ 1018.036907] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('918bf7c8-0ca6-4052-a0a9-38a8db5664ea',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.105744] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e in Status: SUCCESS [ 1018.105933] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e deletion is rescheduled due to dependency. [ 1018.106064] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.106265] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.106500] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.106695] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.106822] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.106928] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.107061] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.107212] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.107325] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c8a6eda-c0ec-4e25-8652-6acf3d57da4e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.251472] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.251875] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.251918] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.252338] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.252575] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.252854] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Segment Port 246df3cd-0d4c-4d2a-8b50-11c3e4a5e226 not found, creating... [ 1018.253211] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.253449] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.253637] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.253957] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.254196] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.254560] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.254812] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.255046] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.255337] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.255545] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.255779] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Resource: SegmentPort with ID: 246df3cd-0d4c-4d2a-8b50-11c3e4a5e226 is going to be created. [ 1018.271060] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e3bdef3-6800-4bd2-84b8-3ef120fd62f1 in Status: SUCCESS [ 1018.271382] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.271649] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.271937] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.272200] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.272333] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.272389] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.272599] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.272748] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.272851] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.273032] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.273142] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.273194] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.273346] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.273484] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.273626] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.273731] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.273933] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.274072] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.274197] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.274339] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2e3bdef3-6800-4bd2-84b8-3ef120fd62f1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.283690] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.283962] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.284106] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.284379] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.284651] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.284829] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "port-246df3cd-0d4c-4d2a-8b50-11c3e4a5e226" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.540748] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.540968] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.541141] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.541407] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.541538] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.541667] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea is going to be updated. [ 1018.569689] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.569829] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.569890] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.570481] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.570481] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.580579] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea in Status: IN_PROGRESS for 2s [ 1018.610126] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1c8a6eda-c0ec-4e25-8652-6acf3d57da4e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.777502] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2e3bdef3-6800-4bd2-84b8-3ef120fd62f1: rpc.has_security_group_logging(os_id): False [ 1018.798932] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.799154] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.799154] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.799468] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.799576] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.799844] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.800023] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.800119] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.800340] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.800428] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.800648] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.800818] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.800892] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.801031] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.801105] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.801371] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.801537] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.801537] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.801660] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.801732] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.802151] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2e3bdef3-6800-4bd2-84b8-3ef120fd62f1 is going to be created. [ 1018.886225] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.886225] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.886225] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.886225] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.886225] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.901073] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2e3bdef3-6800-4bd2-84b8-3ef120fd62f1 in Status: IN_PROGRESS for 2s [ 1019.016902] env[65471]: INFO networking_nsxv3.common.synchronization [req-61a64318-27a0-4d82-872a-b73ab4c4ee70 req-7f4b87df-9a53-43fc-9472-4c7cc8c97874 service nova] Enqueued Resource ID: e8869e0a-9385-48b2-ac90-589c8415df21 with Priority: HIGHEST for action security_group_rules [ 1019.016902] env[65471]: INFO networking_nsxv3.common.synchronization [req-61a64318-27a0-4d82-872a-b73ab4c4ee70 req-7f4b87df-9a53-43fc-9472-4c7cc8c97874 service nova] Enqueued Resource ID: e8869e0a-9385-48b2-ac90-589c8415df21 with Priority: HIGHEST for action security_group_members [ 1019.017016] env[65471]: INFO networking_nsxv3.common.synchronization [req-61a64318-27a0-4d82-872a-b73ab4c4ee70 req-7f4b87df-9a53-43fc-9472-4c7cc8c97874 service nova] Enqueued Resource ID: 246df3cd-0d4c-4d2a-8b50-11c3e4a5e226 with Priority: HIGHEST for action port [ 1019.019192] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8869e0a-9385-48b2-ac90-589c8415df21 with Priority: HIGHEST for action security_group_rules [ 1019.019192] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8869e0a-9385-48b2-ac90-589c8415df21 with Priority: HIGHEST for action security_group_members [ 1019.019192] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 246df3cd-0d4c-4d2a-8b50-11c3e4a5e226 with Priority: HIGHEST for action port [ 1019.019192] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e8869e0a-9385-48b2-ac90-589c8415df21 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.019192] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.019192] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.019456] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.019456] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e8869e0a-9385-48b2-ac90-589c8415df21',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.020728] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8869e0a-9385-48b2-ac90-589c8415df21 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.020876] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.021198] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-246df3cd-0d4c-4d2a-8b50-11c3e4a5e226 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.021371] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-246df3cd-0d4c-4d2a-8b50-11c3e4a5e226" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.021528] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-246df3cd-0d4c-4d2a-8b50-11c3e4a5e226" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.021758] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-246df3cd-0d4c-4d2a-8b50-11c3e4a5e226" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.021892] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('246df3cd-0d4c-4d2a-8b50-11c3e4a5e226',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.113448] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1c8a6eda-c0ec-4e25-8652-6acf3d57da4e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.523754] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8869e0a-9385-48b2-ac90-589c8415df21 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.524095] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.524140] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 246df3cd-0d4c-4d2a-8b50-11c3e4a5e226 with status ACTIVE [ 1019.524298] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.524411] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.524466] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.524703] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.524772] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.524935] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.525100] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.525152] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.525286] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.525365] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.525548] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.525652] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.525699] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.525894] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.525894] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.525997] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 246df3cd-0d4c-4d2a-8b50-11c3e4a5e226 is going to be updated. [ 1019.551376] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.552072] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.552072] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.552222] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.552971] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.552971] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-246df3cd-0d4c-4d2a-8b50-11c3e4a5e226" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.616507] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.616507] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.616507] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.616919] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.616919] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.616919] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e is going to be updated. [ 1019.666231] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.666417] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.666546] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.666797] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.666986] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.676758] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e in Status: IN_PROGRESS for 2s [ 1019.927327] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8869e0a-9385-48b2-ac90-589c8415df21 in Status: SUCCESS [ 1019.927519] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8869e0a-9385-48b2-ac90-589c8415df21 deletion is rescheduled due to dependency. [ 1019.927618] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.927782] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.928019] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.928212] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.928329] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.928393] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.928543] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.928643] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.928717] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e8869e0a-9385-48b2-ac90-589c8415df21',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.076296] env[65471]: INFO networking_nsxv3.common.synchronization [req-d8d1b93c-3381-4b15-995d-35d1e5c6716a req-fec4f1d5-97c1-45da-8563-e53e1f413b55 tempest-ListServerFiltersTestJSON-1343098391 tempest-ListServerFiltersTestJSON-1343098391-project-member] Enqueued Resource ID: 7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 with Priority: HIGHEST for action security_group_members [ 1020.076920] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 with Priority: HIGHEST for action security_group_members [ 1020.077443] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.077573] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.077658] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.077942] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.078083] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.078193] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.078303] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.078441] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.078538] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.078661] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b0e439e-ae4b-45e5-b678-0ea9b193c6d4',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.430905] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e8869e0a-9385-48b2-ac90-589c8415df21',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.582034] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7b0e439e-ae4b-45e5-b678-0ea9b193c6d4',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.591406] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea in Status: SUCCESS [ 1020.591658] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.591833] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.592057] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.592323] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.592452] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.592513] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.592667] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.592799] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.593219] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.593219] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('918bf7c8-0ca6-4052-a0a9-38a8db5664ea',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.594228] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.594393] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.594556] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.594658] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.594725] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.594858] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.594935] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.595026] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('918bf7c8-0ca6-4052-a0a9-38a8db5664ea',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.922190] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2e3bdef3-6800-4bd2-84b8-3ef120fd62f1 in Status: SUCCESS [ 1020.922190] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.922190] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.922190] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.922190] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2e3bdef3-6800-4bd2-84b8-3ef120fd62f1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.934761] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e8869e0a-9385-48b2-ac90-589c8415df21',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.070165] env[65471]: INFO networking_nsxv3.common.synchronization [req-34305caf-3ec3-4d98-aa80-39af398bf38c req-4fd6e34f-3216-47af-9ab0-f96613502ff9 tempest-AttachVolumeNegativeTest-275281664 tempest-AttachVolumeNegativeTest-275281664-project-member] Enqueued Resource ID: 8c8d67e4-5b19-43b8-b618-1f0b1d72c71a with Priority: HIGHEST for action security_group_members [ 1021.071107] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c8d67e4-5b19-43b8-b618-1f0b1d72c71a with Priority: HIGHEST for action security_group_members [ 1021.071197] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c8d67e4-5b19-43b8-b618-1f0b1d72c71a taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.071278] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c8d67e4-5b19-43b8-b618-1f0b1d72c71a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.071324] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c8d67e4-5b19-43b8-b618-1f0b1d72c71a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.071564] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c8d67e4-5b19-43b8-b618-1f0b1d72c71a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.071718] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.071848] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.071902] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.072195] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.072195] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.072506] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c8d67e4-5b19-43b8-b618-1f0b1d72c71a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.084238] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7b0e439e-ae4b-45e5-b678-0ea9b193c6d4',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.098063] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.098205] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.098379] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('918bf7c8-0ca6-4052-a0a9-38a8db5664ea',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.429953] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.430242] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.430344] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.430660] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.430868] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.430978] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.431112] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.431224] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.431314] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.431401] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.431499] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2e3bdef3-6800-4bd2-84b8-3ef120fd62f1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.437717] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.437865] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.437948] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.438320] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.438533] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.438533] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8869e0a-9385-48b2-ac90-589c8415df21 is going to be updated. [ 1021.469329] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.469570] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.469570] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.469827] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.470030] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.481493] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8869e0a-9385-48b2-ac90-589c8415df21 in Status: IN_PROGRESS for 2s [ 1021.484282] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock network-507 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.484587] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "network-507" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.484683] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "network-507" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.484916] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "network-507" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.485213] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.485367] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.485480] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.485709] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.485870] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.486101] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1021.486201] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1021.486311] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1021.486414] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1021.486518] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1021.486618] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1021.486750] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1021.509808] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1021.510209] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1021.510447] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1021.510740] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "network-507" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.511195] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock port-c93bb6c7-aac9-47b4-a798-4765d1e25dde taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.511418] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "port-c93bb6c7-aac9-47b4-a798-4765d1e25dde" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.511545] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "port-c93bb6c7-aac9-47b4-a798-4765d1e25dde" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.511880] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "port-c93bb6c7-aac9-47b4-a798-4765d1e25dde" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.512051] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c93bb6c7-aac9-47b4-a798-4765d1e25dde',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.574454] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.574721] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.574777] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.575080] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.575293] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.575530] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.575672] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.575757] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.575929] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.576054] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.576139] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c8d67e4-5b19-43b8-b618-1f0b1d72c71a already deleted. [ 1021.576231] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c8d67e4-5b19-43b8-b618-1f0b1d72c71a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.586238] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.586756] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.586850] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.587196] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.587332] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.587482] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 is going to be updated. [ 1021.600613] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('918bf7c8-0ca6-4052-a0a9-38a8db5664ea',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.620139] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.620139] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.620139] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.620371] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.620479] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.632420] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 in Status: IN_PROGRESS for 2s [ 1021.686909] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e in Status: SUCCESS [ 1021.687227] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.687394] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.687619] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.687807] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.687922] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.687987] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.688147] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.688228] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.688314] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.688410] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1c8a6eda-c0ec-4e25-8652-6acf3d57da4e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.934953] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.934953] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.934953] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.935282] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.935339] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.935476] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.935554] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.935767] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.935884] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.935983] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.936195] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.936349] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.936427] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.936604] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.936775] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.936915] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.936964] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.937166] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.937254] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.937352] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.937470] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2e3bdef3-6800-4bd2-84b8-3ef120fd62f1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.019859] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.020294] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.020411] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.020728] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.020885] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.021066] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Segment Port c93bb6c7-aac9-47b4-a798-4765d1e25dde not found, creating... [ 1022.021449] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.021629] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.021746] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.022018] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.022217] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.022560] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.022729] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.023066] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.023473] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.023720] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.023945] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Resource: SegmentPort with ID: c93bb6c7-aac9-47b4-a798-4765d1e25dde is going to be created. [ 1022.050166] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.050425] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.050515] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.050808] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.051032] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.051292] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "port-c93bb6c7-aac9-47b4-a798-4765d1e25dde" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.105130] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.105403] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.105466] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.105781] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.105995] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.106163] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea is going to be updated. [ 1022.151659] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.152274] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.152274] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.152463] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.152566] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.167907] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea in Status: IN_PROGRESS for 2s [ 1022.190571] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.190807] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.190891] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.191197] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.191408] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.191514] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.191585] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.191786] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.191964] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.191964] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.192273] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.192273] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.192273] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.192472] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.192594] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.192685] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.192941] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.193113] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.193204] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.193289] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.193386] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1c8a6eda-c0ec-4e25-8652-6acf3d57da4e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.440517] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2e3bdef3-6800-4bd2-84b8-3ef120fd62f1: rpc.has_security_group_logging(os_id): False [ 1022.459452] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.459849] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.459849] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.459975] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.459975] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.460722] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.460722] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.460722] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.460722] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.460722] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.461146] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.461146] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.461246] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.461403] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.461519] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.461806] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.461910] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.461969] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.462153] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.462254] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.462345] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2e3bdef3-6800-4bd2-84b8-3ef120fd62f1 is going to be updated. [ 1022.543900] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.544134] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.544209] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.544394] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.544545] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.559441] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2e3bdef3-6800-4bd2-84b8-3ef120fd62f1 in Status: IN_PROGRESS for 2s [ 1022.625568] env[65471]: INFO networking_nsxv3.common.synchronization [req-ce69b663-2f59-4d41-a46f-eab49bf79123 req-30bd6165-6661-435e-83fc-7a6f7564884c tempest-DeleteServersTestJSON-72429361 tempest-DeleteServersTestJSON-72429361-project-member] Enqueued Resource ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 with Priority: HIGHEST for action security_group_members [ 1022.626172] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 with Priority: HIGHEST for action security_group_members [ 1022.626608] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-c35d5123-3fe1-447f-aedc-8112e5faa2b6 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.626744] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.626816] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.627015] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.627180] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.627277] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.627334] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.627466] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.627550] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.627644] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c35d5123-3fe1-447f-aedc-8112e5faa2b6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.696433] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e: rpc.has_security_group_logging(os_id): False [ 1022.727121] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.727350] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.727350] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.727690] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.727690] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.727863] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.728019] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.728059] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.729828] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.729828] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.729828] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.729828] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.729828] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.729828] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.729828] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.729828] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.729828] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.729828] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.729828] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.729828] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.729828] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e is going to be updated. [ 1022.778767] env[65471]: INFO networking_nsxv3.common.synchronization [req-34305caf-3ec3-4d98-aa80-39af398bf38c req-b71f9d99-243f-4d73-8b02-403f903c2d66 service nova] Enqueued Resource ID: 8c8d67e4-5b19-43b8-b618-1f0b1d72c71a with Priority: HIGHEST for action security_group_rules [ 1022.778996] env[65471]: INFO networking_nsxv3.common.synchronization [req-34305caf-3ec3-4d98-aa80-39af398bf38c req-b71f9d99-243f-4d73-8b02-403f903c2d66 service nova] Enqueued Resource ID: 8c8d67e4-5b19-43b8-b618-1f0b1d72c71a with Priority: HIGHEST for action security_group_members [ 1022.779214] env[65471]: INFO networking_nsxv3.common.synchronization [req-34305caf-3ec3-4d98-aa80-39af398bf38c req-b71f9d99-243f-4d73-8b02-403f903c2d66 service nova] Enqueued Resource ID: c93bb6c7-aac9-47b4-a798-4765d1e25dde with Priority: HIGHEST for action port [ 1022.779805] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c8d67e4-5b19-43b8-b618-1f0b1d72c71a with Priority: HIGHEST for action security_group_rules [ 1022.779989] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c8d67e4-5b19-43b8-b618-1f0b1d72c71a with Priority: HIGHEST for action security_group_members [ 1022.780139] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c93bb6c7-aac9-47b4-a798-4765d1e25dde with Priority: HIGHEST for action port [ 1022.780495] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c8d67e4-5b19-43b8-b618-1f0b1d72c71a taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.780646] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c8d67e4-5b19-43b8-b618-1f0b1d72c71a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.780791] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c8d67e4-5b19-43b8-b618-1f0b1d72c71a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.781025] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c8d67e4-5b19-43b8-b618-1f0b1d72c71a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.781136] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c8d67e4-5b19-43b8-b618-1f0b1d72c71a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.782250] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c8d67e4-5b19-43b8-b618-1f0b1d72c71a taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.782403] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c8d67e4-5b19-43b8-b618-1f0b1d72c71a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.782496] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c8d67e4-5b19-43b8-b618-1f0b1d72c71a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.782725] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c8d67e4-5b19-43b8-b618-1f0b1d72c71a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.783410] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.783556] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.783649] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.783876] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.783986] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.784201] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c8d67e4-5b19-43b8-b618-1f0b1d72c71a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.785588] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-c93bb6c7-aac9-47b4-a798-4765d1e25dde taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.785730] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c93bb6c7-aac9-47b4-a798-4765d1e25dde" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.785822] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c93bb6c7-aac9-47b4-a798-4765d1e25dde" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.786042] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c93bb6c7-aac9-47b4-a798-4765d1e25dde" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.786156] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c93bb6c7-aac9-47b4-a798-4765d1e25dde',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.794525] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.794732] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.794795] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.795065] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.795259] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.817951] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e in Status: IN_PROGRESS for 2s [ 1023.129517] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.129727] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.129799] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.130259] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.130415] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.130694] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.130850] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.130972] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.131213] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.131301] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.131385] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 is going to be updated. [ 1023.167468] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.167790] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.167790] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.167969] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.168170] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.177649] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 in Status: IN_PROGRESS for 2s [ 1023.288359] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c8d67e4-5b19-43b8-b618-1f0b1d72c71a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.289530] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c8d67e4-5b19-43b8-b618-1f0b1d72c71a taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.289671] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c8d67e4-5b19-43b8-b618-1f0b1d72c71a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.289915] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c93bb6c7-aac9-47b4-a798-4765d1e25dde with status ACTIVE [ 1023.290016] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.290112] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.291068] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.291068] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.291068] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.291068] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.291068] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.291068] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.291068] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.291068] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.291418] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.291418] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.291418] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.291529] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.291529] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.291620] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c93bb6c7-aac9-47b4-a798-4765d1e25dde is going to be updated. [ 1023.323648] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.323905] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.324079] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.324259] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.324431] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.324635] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c93bb6c7-aac9-47b4-a798-4765d1e25dde" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.494718] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8869e0a-9385-48b2-ac90-589c8415df21 in Status: SUCCESS [ 1023.494981] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.495221] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.495475] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.495676] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.495905] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.496041] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.496156] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.496242] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.496332] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.496420] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e8869e0a-9385-48b2-ac90-589c8415df21',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.642957] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 in Status: SUCCESS [ 1023.643383] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.794938] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c8d67e4-5b19-43b8-b618-1f0b1d72c71a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.855360] env[65471]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1023.855360] env[65471]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] NSXv3 Agent Agent loop - iteration:2 started [ 1023.999195] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8869e0a-9385-48b2-ac90-589c8415df21 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.999360] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.999434] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.999651] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.999820] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.999925] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.999990] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.000152] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.000238] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.000327] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.000470] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8869e0a-9385-48b2-ac90-589c8415df21 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.000579] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.000616] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.000745] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.000879] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.000969] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.001039] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.001172] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.001244] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.001323] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.001413] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e8869e0a-9385-48b2-ac90-589c8415df21',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.178978] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea in Status: SUCCESS [ 1024.178978] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.178978] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.178978] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.178978] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.178978] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.178978] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.179478] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.179478] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.179579] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.179816] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.179960] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.180078] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.180307] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.180562] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.180667] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.180729] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.180872] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.180952] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.181358] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.181358] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('918bf7c8-0ca6-4052-a0a9-38a8db5664ea',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.297502] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.297668] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.297738] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.298059] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.298174] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.298504] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c8d67e4-5b19-43b8-b618-1f0b1d72c71a is going to be created. [ 1024.327780] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.327780] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.327780] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.328165] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.328251] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.342158] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c8d67e4-5b19-43b8-b618-1f0b1d72c71a in Status: UNINITIALIZED for 2s [ 1024.503703] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e8869e0a-9385-48b2-ac90-589c8415df21: rpc.has_security_group_logging(os_id): False [ 1024.527251] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.527251] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.527251] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.527501] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.527577] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.527845] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.527967] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.528040] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.528200] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.528279] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.528477] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.528567] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.528699] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.528761] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.528832] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.529038] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.529130] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.529185] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.529327] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.529396] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.530094] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e8869e0a-9385-48b2-ac90-589c8415df21 is going to be updated. [ 1024.556571] env[65471]: INFO networking_nsxv3.common.synchronization [None req-cbc159a9-329c-426e-8b33-c9c849fdef72 tempest-AttachInterfacesTestJSON-1197806586 tempest-AttachInterfacesTestJSON-1197806586-project-member] Enqueued Resource ID: e8869e0a-9385-48b2-ac90-589c8415df21 with Priority: HIGHEST for action security_group_members [ 1024.557201] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8869e0a-9385-48b2-ac90-589c8415df21 with Priority: HIGHEST for action security_group_members [ 1024.557533] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8869e0a-9385-48b2-ac90-589c8415df21 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.557646] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.557714] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.557922] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.558096] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.558201] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.558261] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.558417] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.558559] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.558559] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e8869e0a-9385-48b2-ac90-589c8415df21',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.574684] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2e3bdef3-6800-4bd2-84b8-3ef120fd62f1 in Status: SUCCESS [ 1024.575016] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.601933] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.602166] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.602287] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.602629] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.602918] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.618804] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e8869e0a-9385-48b2-ac90-589c8415df21 in Status: IN_PROGRESS for 2s [ 1024.685376] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 918bf7c8-0ca6-4052-a0a9-38a8db5664ea: rpc.has_security_group_logging(os_id): False [ 1024.715206] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.715206] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.715206] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.715206] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.715206] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.715206] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.715206] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.715206] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.715206] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.715206] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.715206] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.715206] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.715206] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.715206] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.716258] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.717388] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.717388] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.717388] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.717388] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.717388] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.717388] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea is going to be updated. [ 1024.796776] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.796991] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.797086] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.797317] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.797488] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.817024] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea in Status: IN_PROGRESS for 2s [ 1024.836479] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e in Status: SUCCESS [ 1024.836479] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.061896] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e8869e0a-9385-48b2-ac90-589c8415df21',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.190340] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 in Status: SUCCESS [ 1025.190567] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 deletion is rescheduled due to dependency. [ 1025.190660] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.563835] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e8869e0a-9385-48b2-ac90-589c8415df21',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.653519] env[65471]: INFO networking_nsxv3.common.synchronization [req-b588864b-6a61-492b-95f4-3e2b0d863482 req-20877da0-d102-443b-b955-197c3929fcd3 tempest-ImagesTestJSON-650286870 tempest-ImagesTestJSON-650286870-project-member] Enqueued Resource ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f with Priority: HIGHEST for action security_group_members [ 1025.654198] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f with Priority: HIGHEST for action security_group_members [ 1025.654544] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-85af6c5e-2f9b-491d-9584-96c44b20f99f taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.654744] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.654744] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.654930] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.655099] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.655201] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.655260] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.655406] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.655489] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.655591] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85af6c5e-2f9b-491d-9584-96c44b20f99f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.998064] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock network-235 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.998435] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "network-235" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.998488] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "network-235" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.998807] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "network-235" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.999191] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.999410] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.999605] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.999937] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.000145] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.000787] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1026.000787] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1026.000787] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1026.000980] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1026.001046] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1026.001217] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1026.001387] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1026.020279] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1026.020512] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1026.020713] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1026.020983] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "network-235" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.021416] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock port-a5f2a8bb-b597-4a13-8491-145c795d7f77 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.021653] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "port-a5f2a8bb-b597-4a13-8491-145c795d7f77" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.021823] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "port-a5f2a8bb-b597-4a13-8491-145c795d7f77" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.022230] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "port-a5f2a8bb-b597-4a13-8491-145c795d7f77" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.022463] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5f2a8bb-b597-4a13-8491-145c795d7f77',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.066664] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.066838] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.066927] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.067253] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.067369] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.067506] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8869e0a-9385-48b2-ac90-589c8415df21 is going to be updated. [ 1026.100989] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.101356] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.101356] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.101583] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.101733] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.113401] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8869e0a-9385-48b2-ac90-589c8415df21 in Status: IN_PROGRESS for 2s [ 1026.157853] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.158103] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.158157] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.158387] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.158500] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.158764] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.158912] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.158993] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.159252] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.159380] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.159444] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f is going to be updated. [ 1026.192654] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.192807] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.192887] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.193213] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.193414] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.204986] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f in Status: IN_PROGRESS for 2s [ 1026.356923] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c8d67e4-5b19-43b8-b618-1f0b1d72c71a in Status: SUCCESS [ 1026.357188] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c8d67e4-5b19-43b8-b618-1f0b1d72c71a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.357374] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c8d67e4-5b19-43b8-b618-1f0b1d72c71a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.357607] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c8d67e4-5b19-43b8-b618-1f0b1d72c71a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.358404] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.358404] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.358404] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.358404] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.358404] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.358404] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c8d67e4-5b19-43b8-b618-1f0b1d72c71a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.358404] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8c8d67e4-5b19-43b8-b618-1f0b1d72c71a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.526793] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.526937] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.527067] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.527265] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.527424] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.527579] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Segment Port a5f2a8bb-b597-4a13-8491-145c795d7f77 not found, creating... [ 1026.527845] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.528015] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.528132] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.528587] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.528587] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.528778] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.528934] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.529071] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.529359] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.529514] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.529657] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Resource: SegmentPort with ID: a5f2a8bb-b597-4a13-8491-145c795d7f77 is going to be created. [ 1026.554204] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.554204] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.554204] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.554204] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.554519] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.554609] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "port-a5f2a8bb-b597-4a13-8491-145c795d7f77" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.636793] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e8869e0a-9385-48b2-ac90-589c8415df21 in Status: SUCCESS [ 1026.637048] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.833455] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea in Status: SUCCESS [ 1026.833686] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.833929] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.834235] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.834328] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('918bf7c8-0ca6-4052-a0a9-38a8db5664ea',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.860188] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8c8d67e4-5b19-43b8-b618-1f0b1d72c71a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.016267] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock network-238 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.016585] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "network-238" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.016585] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "network-238" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.016890] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "network-238" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.017300] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.017446] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.017493] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.017723] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.017864] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.018111] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1027.018263] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1027.018396] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1027.018521] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1027.018645] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1027.018761] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1027.018909] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1027.039828] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1027.040213] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1027.040487] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1027.040731] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "network-238" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.041137] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock port-ade1a102-1a1a-46d1-b145-b66ab96388bb taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.041350] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "port-ade1a102-1a1a-46d1-b145-b66ab96388bb" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.041489] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "port-ade1a102-1a1a-46d1-b145-b66ab96388bb" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.041899] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "port-ade1a102-1a1a-46d1-b145-b66ab96388bb" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.042119] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ade1a102-1a1a-46d1-b145-b66ab96388bb',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.294954] env[65471]: INFO networking_nsxv3.common.synchronization [req-b588864b-6a61-492b-95f4-3e2b0d863482 req-44c557dc-a376-4e42-8bfa-2a1faf6e2d5d service nova] Enqueued Resource ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f with Priority: HIGHEST for action security_group_rules [ 1027.295237] env[65471]: INFO networking_nsxv3.common.synchronization [req-b588864b-6a61-492b-95f4-3e2b0d863482 req-44c557dc-a376-4e42-8bfa-2a1faf6e2d5d service nova] Enqueued Resource ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f with Priority: HIGHEST for action security_group_members [ 1027.295396] env[65471]: INFO networking_nsxv3.common.synchronization [req-b588864b-6a61-492b-95f4-3e2b0d863482 req-44c557dc-a376-4e42-8bfa-2a1faf6e2d5d service nova] Enqueued Resource ID: a5f2a8bb-b597-4a13-8491-145c795d7f77 with Priority: HIGHEST for action port [ 1027.296286] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f with Priority: HIGHEST for action security_group_rules [ 1027.296418] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f with Priority: HIGHEST for action security_group_members [ 1027.296522] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5f2a8bb-b597-4a13-8491-145c795d7f77 with Priority: HIGHEST for action port [ 1027.297080] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85af6c5e-2f9b-491d-9584-96c44b20f99f taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.297080] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.297233] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.297358] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.297438] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85af6c5e-2f9b-491d-9584-96c44b20f99f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.299432] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-85af6c5e-2f9b-491d-9584-96c44b20f99f taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.299608] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.299943] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-a5f2a8bb-b597-4a13-8491-145c795d7f77 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.300174] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a5f2a8bb-b597-4a13-8491-145c795d7f77" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.300279] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a5f2a8bb-b597-4a13-8491-145c795d7f77" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.300568] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a5f2a8bb-b597-4a13-8491-145c795d7f77" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.300685] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5f2a8bb-b597-4a13-8491-145c795d7f77',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.336488] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.336704] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.336704] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.336926] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.337112] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.337208] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.337886] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.337886] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.337886] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.337886] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.337886] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('918bf7c8-0ca6-4052-a0a9-38a8db5664ea',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.361848] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8c8d67e4-5b19-43b8-b618-1f0b1d72c71a: rpc.has_security_group_logging(os_id): False [ 1027.381968] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.382263] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.382263] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.382455] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.382511] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.382790] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.382948] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.382948] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.383082] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.383165] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.383248] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c8d67e4-5b19-43b8-b618-1f0b1d72c71a is going to be created. [ 1027.466493] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.466681] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.466681] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.466904] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.467098] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.483764] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c8d67e4-5b19-43b8-b618-1f0b1d72c71a in Status: IN_PROGRESS for 2s [ 1027.544712] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.545607] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.545607] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.545607] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.545773] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.545827] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Segment Port ade1a102-1a1a-46d1-b145-b66ab96388bb not found, creating... [ 1027.546095] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.546262] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.546456] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.546709] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.546935] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.547169] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.547319] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.547437] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.547644] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.547774] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.547915] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Resource: SegmentPort with ID: ade1a102-1a1a-46d1-b145-b66ab96388bb is going to be created. [ 1027.568950] env[65471]: INFO networking_nsxv3.common.synchronization [req-115562e4-9da8-4dd1-b3a1-441633d3e948 req-32934220-437c-43f6-9121-60c7c30e992c tempest-ServersTestMultiNic-44021310 tempest-ServersTestMultiNic-44021310-project-member] Enqueued Resource ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea with Priority: HIGHEST for action security_group_members [ 1027.569795] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea with Priority: HIGHEST for action security_group_members [ 1027.569848] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.569949] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.572098] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.573148] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.573378] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.573742] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.573742] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.573742] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.573842] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.573930] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('918bf7c8-0ca6-4052-a0a9-38a8db5664ea',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.583199] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.583414] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.583467] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.583772] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.583998] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.584242] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "port-ade1a102-1a1a-46d1-b145-b66ab96388bb" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.789522] env[65471]: INFO networking_nsxv3.common.synchronization [req-115562e4-9da8-4dd1-b3a1-441633d3e948 req-927e46b5-92e2-41b2-9583-28a78e84f1d0 tempest-ServersTestMultiNic-44021310 tempest-ServersTestMultiNic-44021310-project-member] Enqueued Resource ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea with Priority: HIGHEST for action security_group_members [ 1027.790437] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea with Priority: HIGHEST for action security_group_members [ 1027.790825] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.791017] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.800233] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-85af6c5e-2f9b-491d-9584-96c44b20f99f taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.800233] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.803606] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a5f2a8bb-b597-4a13-8491-145c795d7f77 with status ACTIVE [ 1027.803858] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.804023] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.804075] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.804316] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.804476] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.804604] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.804719] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.804782] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.804934] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.805055] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.805228] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.805323] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.805475] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.805513] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.806460] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.806460] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a5f2a8bb-b597-4a13-8491-145c795d7f77 is going to be updated. [ 1027.832286] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.832470] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.832517] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.832694] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.832824] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.833028] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a5f2a8bb-b597-4a13-8491-145c795d7f77" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.841626] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.841744] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.078928] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('918bf7c8-0ca6-4052-a0a9-38a8db5664ea',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.129082] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8869e0a-9385-48b2-ac90-589c8415df21 in Status: SUCCESS [ 1028.129355] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.215678] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f in Status: IN_PROGRESS for 4s [ 1028.284571] env[65471]: INFO networking_nsxv3.common.synchronization [req-cf753658-a31f-47db-892c-e86c05799169 req-d44405c5-1f43-40b4-85a8-3d65ac6060b7 service nova] Enqueued Resource ID: e8869e0a-9385-48b2-ac90-589c8415df21 with Priority: HIGHEST for action security_group_rules [ 1028.284788] env[65471]: INFO networking_nsxv3.common.synchronization [req-cf753658-a31f-47db-892c-e86c05799169 req-d44405c5-1f43-40b4-85a8-3d65ac6060b7 service nova] Enqueued Resource ID: e8869e0a-9385-48b2-ac90-589c8415df21 with Priority: HIGHEST for action security_group_members [ 1028.284944] env[65471]: INFO networking_nsxv3.common.synchronization [req-cf753658-a31f-47db-892c-e86c05799169 req-d44405c5-1f43-40b4-85a8-3d65ac6060b7 service nova] Enqueued Resource ID: ade1a102-1a1a-46d1-b145-b66ab96388bb with Priority: HIGHEST for action port [ 1028.285619] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8869e0a-9385-48b2-ac90-589c8415df21 with Priority: HIGHEST for action security_group_rules [ 1028.285772] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8869e0a-9385-48b2-ac90-589c8415df21 with Priority: HIGHEST for action security_group_members [ 1028.285884] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ade1a102-1a1a-46d1-b145-b66ab96388bb with Priority: HIGHEST for action port [ 1028.286359] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e8869e0a-9385-48b2-ac90-589c8415df21 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.286511] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.286573] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.286836] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.286887] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e8869e0a-9385-48b2-ac90-589c8415df21',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.288777] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8869e0a-9385-48b2-ac90-589c8415df21 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.288777] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.288777] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.288924] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.289983] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.289983] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.289983] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.289983] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.289983] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.289983] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e8869e0a-9385-48b2-ac90-589c8415df21',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.290949] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-ade1a102-1a1a-46d1-b145-b66ab96388bb taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.291096] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ade1a102-1a1a-46d1-b145-b66ab96388bb" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.291168] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ade1a102-1a1a-46d1-b145-b66ab96388bb" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.291764] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ade1a102-1a1a-46d1-b145-b66ab96388bb" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.291764] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ade1a102-1a1a-46d1-b145-b66ab96388bb',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.582132] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('918bf7c8-0ca6-4052-a0a9-38a8db5664ea',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.789451] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8869e0a-9385-48b2-ac90-589c8415df21 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.789622] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.792073] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e8869e0a-9385-48b2-ac90-589c8415df21',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.793052] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ade1a102-1a1a-46d1-b145-b66ab96388bb with status ACTIVE [ 1028.793282] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.793435] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.793836] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.793836] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.793836] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.794060] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.794170] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.794236] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.794419] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.794508] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.794703] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.794800] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.794854] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.795048] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.795167] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.795240] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ade1a102-1a1a-46d1-b145-b66ab96388bb is going to be updated. [ 1028.826604] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.826776] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.826863] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.827194] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.827396] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.827610] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ade1a102-1a1a-46d1-b145-b66ab96388bb" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.084463] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.084861] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.084861] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.084948] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.084981] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.085116] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea is going to be updated. [ 1029.117554] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.117774] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.117774] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.118099] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.118261] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.131241] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea in Status: IN_PROGRESS for 2s [ 1029.297082] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e8869e0a-9385-48b2-ac90-589c8415df21',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.501939] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c8d67e4-5b19-43b8-b618-1f0b1d72c71a in Status: SUCCESS [ 1029.502212] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c8d67e4-5b19-43b8-b618-1f0b1d72c71a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.800029] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.800178] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.800228] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.800436] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.800528] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.800633] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8869e0a-9385-48b2-ac90-589c8415df21 is going to be updated. [ 1029.830688] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.830907] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.830907] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.831101] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.831255] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.842013] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8869e0a-9385-48b2-ac90-589c8415df21 in Status: IN_PROGRESS for 2s [ 1030.201534] env[65471]: INFO networking_nsxv3.common.synchronization [req-9e4dbbf2-4a68-49ab-9922-75999a8948f5 req-eebd529c-f118-4c75-b198-e5c991096d01 tempest-ServerActionsTestJSON-1061383532 tempest-ServerActionsTestJSON-1061383532-project-member] Enqueued Resource ID: 847d876e-b40b-4d73-9c81-1622676c73b5 with Priority: HIGHEST for action security_group_members [ 1030.202159] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 847d876e-b40b-4d73-9c81-1622676c73b5 with Priority: HIGHEST for action security_group_members [ 1030.202475] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-847d876e-b40b-4d73-9c81-1622676c73b5 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.202600] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-847d876e-b40b-4d73-9c81-1622676c73b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.202665] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-847d876e-b40b-4d73-9c81-1622676c73b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.202856] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-847d876e-b40b-4d73-9c81-1622676c73b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.203174] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.203304] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.203371] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.203528] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.203613] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.203707] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('847d876e-b40b-4d73-9c81-1622676c73b5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.225778] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f in Status: SUCCESS [ 1030.226016] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f deletion is rescheduled due to dependency. [ 1030.226148] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.226327] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.226547] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.226743] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.226913] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.226913] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.227257] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.227381] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.227517] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85af6c5e-2f9b-491d-9584-96c44b20f99f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.706080] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.706080] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.706371] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.706371] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.706479] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.706643] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.706773] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.706773] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.706927] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.707000] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.707097] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 847d876e-b40b-4d73-9c81-1622676c73b5 is going to be updated. [ 1030.729598] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('85af6c5e-2f9b-491d-9584-96c44b20f99f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.734143] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.734274] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.734342] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.734574] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.734678] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.743360] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 847d876e-b40b-4d73-9c81-1622676c73b5 in Status: IN_PROGRESS for 2s [ 1031.142888] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea in Status: SUCCESS [ 1031.143325] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.143742] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.144135] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.144344] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.144464] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.144529] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.144688] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.144772] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.144891] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('918bf7c8-0ca6-4052-a0a9-38a8db5664ea',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.232459] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('85af6c5e-2f9b-491d-9584-96c44b20f99f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.648514] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.648822] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.648822] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.648991] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.649102] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.649366] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.649477] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.649562] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.649787] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.649982] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.650136] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea is going to be updated. [ 1031.684473] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.684640] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.684723] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.684987] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.685157] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.698062] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea in Status: IN_PROGRESS for 2s [ 1031.734752] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.734963] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.734963] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.735212] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.735336] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.735492] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f is going to be updated. [ 1031.779730] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.779891] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.779934] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.780168] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.780310] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.793832] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f in Status: IN_PROGRESS for 2s [ 1031.853736] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8869e0a-9385-48b2-ac90-589c8415df21 in Status: SUCCESS [ 1031.853990] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.854180] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.854579] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.854579] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.854762] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.854762] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.855330] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.855330] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.855330] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.855330] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e8869e0a-9385-48b2-ac90-589c8415df21',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.343570] env[65471]: INFO networking_nsxv3.common.synchronization [req-edcf8778-0b61-4a4a-b7e2-76762bc21d88 req-298a6ad7-3d30-48a9-835f-eca980b8f000 tempest-ListImageFiltersTestJSON-417187835 tempest-ListImageFiltersTestJSON-417187835-project-member] Enqueued Resource ID: 2c8ff43e-9a83-418c-851d-179c01ee77a0 with Priority: HIGHEST for action security_group_members [ 1032.343570] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c8ff43e-9a83-418c-851d-179c01ee77a0 with Priority: HIGHEST for action security_group_members [ 1032.343570] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c8ff43e-9a83-418c-851d-179c01ee77a0 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.343570] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c8ff43e-9a83-418c-851d-179c01ee77a0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.344186] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c8ff43e-9a83-418c-851d-179c01ee77a0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.347542] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c8ff43e-9a83-418c-851d-179c01ee77a0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.347824] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.347935] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.347935] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.348145] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.348230] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.348985] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c8ff43e-9a83-418c-851d-179c01ee77a0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.357803] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8869e0a-9385-48b2-ac90-589c8415df21 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.358052] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.358146] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.359911] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.359911] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.359911] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.359911] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.359911] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.359911] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.359911] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.359911] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8869e0a-9385-48b2-ac90-589c8415df21 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.359911] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.359911] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.359911] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.359911] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.359911] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.359911] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.362328] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.362328] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.362328] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.364779] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e8869e0a-9385-48b2-ac90-589c8415df21',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.755781] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 847d876e-b40b-4d73-9c81-1622676c73b5 in Status: SUCCESS [ 1032.756235] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 847d876e-b40b-4d73-9c81-1622676c73b5 deletion is rescheduled due to dependency. [ 1032.756235] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-847d876e-b40b-4d73-9c81-1622676c73b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.820684] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock network-647 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.820955] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "network-647" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.821106] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "network-647" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.821424] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "network-647" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.821709] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.821876] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.821994] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.823377] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.823582] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.823822] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1032.823965] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1032.824090] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1032.824296] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1032.824296] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1032.824405] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1032.824542] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1032.847444] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1032.847722] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1032.848228] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1032.848228] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "network-647" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.848526] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock port-65f6a624-226f-4ef4-8088-2f17fe41150d taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.849861] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "port-65f6a624-226f-4ef4-8088-2f17fe41150d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.849861] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "port-65f6a624-226f-4ef4-8088-2f17fe41150d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.849861] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "port-65f6a624-226f-4ef4-8088-2f17fe41150d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.849861] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65f6a624-226f-4ef4-8088-2f17fe41150d',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.854099] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.854099] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.854099] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.854099] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.854099] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.854099] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.854099] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.854099] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.854761] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.855466] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.855614] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c8ff43e-9a83-418c-851d-179c01ee77a0 already deleted. [ 1032.855742] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c8ff43e-9a83-418c-851d-179c01ee77a0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.867743] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e8869e0a-9385-48b2-ac90-589c8415df21: rpc.has_security_group_logging(os_id): False [ 1032.886746] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.886910] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.887179] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.891238] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.891238] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.891238] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.891238] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.891238] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.891238] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.891238] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.891238] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.891238] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.891238] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.891238] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.891238] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.891750] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.891750] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.891750] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.891750] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.891893] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.891893] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e8869e0a-9385-48b2-ac90-589c8415df21 is going to be updated. [ 1032.967651] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.967651] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.967651] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.967945] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.967945] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.984181] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e8869e0a-9385-48b2-ac90-589c8415df21 in Status: IN_PROGRESS for 2s [ 1033.356327] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.356327] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.356327] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.356327] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.356327] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.356327] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Segment Port 65f6a624-226f-4ef4-8088-2f17fe41150d not found, creating... [ 1033.356327] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.356327] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.356327] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.357173] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.357173] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.357442] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.357711] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.357919] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.358283] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.358656] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.358930] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Resource: SegmentPort with ID: 65f6a624-226f-4ef4-8088-2f17fe41150d is going to be created. [ 1033.393652] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.393863] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.393984] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.394358] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.394535] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.394768] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "port-65f6a624-226f-4ef4-8088-2f17fe41150d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.709100] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea in Status: SUCCESS [ 1033.709406] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea deletion is rescheduled due to dependency. [ 1033.709505] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.709762] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.709973] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.710179] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.710304] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.710385] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.710506] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.710590] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.710679] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.710883] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.711000] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.711132] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.711207] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.711336] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.711440] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.711536] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.711612] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.711687] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.711760] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.711852] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('918bf7c8-0ca6-4052-a0a9-38a8db5664ea',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.805039] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f in Status: SUCCESS [ 1033.805039] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.805039] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.805039] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.805329] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.805470] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.805555] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.805721] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.805818] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.805886] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.806022] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('85af6c5e-2f9b-491d-9584-96c44b20f99f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.060298] env[65471]: INFO networking_nsxv3.common.synchronization [req-edcf8778-0b61-4a4a-b7e2-76762bc21d88 req-05699108-4334-4ef2-a49c-c1f053511493 service nova] Enqueued Resource ID: 2c8ff43e-9a83-418c-851d-179c01ee77a0 with Priority: HIGHEST for action security_group_rules [ 1034.060468] env[65471]: INFO networking_nsxv3.common.synchronization [req-edcf8778-0b61-4a4a-b7e2-76762bc21d88 req-05699108-4334-4ef2-a49c-c1f053511493 service nova] Enqueued Resource ID: 2c8ff43e-9a83-418c-851d-179c01ee77a0 with Priority: HIGHEST for action security_group_members [ 1034.060596] env[65471]: INFO networking_nsxv3.common.synchronization [req-edcf8778-0b61-4a4a-b7e2-76762bc21d88 req-05699108-4334-4ef2-a49c-c1f053511493 service nova] Enqueued Resource ID: 65f6a624-226f-4ef4-8088-2f17fe41150d with Priority: HIGHEST for action port [ 1034.061177] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c8ff43e-9a83-418c-851d-179c01ee77a0 with Priority: HIGHEST for action security_group_rules [ 1034.061328] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c8ff43e-9a83-418c-851d-179c01ee77a0 with Priority: HIGHEST for action security_group_members [ 1034.061431] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65f6a624-226f-4ef4-8088-2f17fe41150d with Priority: HIGHEST for action port [ 1034.061749] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c8ff43e-9a83-418c-851d-179c01ee77a0 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.061833] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c8ff43e-9a83-418c-851d-179c01ee77a0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.061886] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c8ff43e-9a83-418c-851d-179c01ee77a0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.062164] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c8ff43e-9a83-418c-851d-179c01ee77a0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.062221] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c8ff43e-9a83-418c-851d-179c01ee77a0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.063692] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c8ff43e-9a83-418c-851d-179c01ee77a0 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.063692] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c8ff43e-9a83-418c-851d-179c01ee77a0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.063692] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c8ff43e-9a83-418c-851d-179c01ee77a0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.063692] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c8ff43e-9a83-418c-851d-179c01ee77a0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.063692] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.064023] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.064023] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.064023] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.064124] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.064218] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c8ff43e-9a83-418c-851d-179c01ee77a0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.065106] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-65f6a624-226f-4ef4-8088-2f17fe41150d taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.065178] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-65f6a624-226f-4ef4-8088-2f17fe41150d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.065214] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-65f6a624-226f-4ef4-8088-2f17fe41150d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.065389] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-65f6a624-226f-4ef4-8088-2f17fe41150d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.065466] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65f6a624-226f-4ef4-8088-2f17fe41150d',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.215035] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 918bf7c8-0ca6-4052-a0a9-38a8db5664ea: rpc.has_security_group_logging(os_id): False [ 1034.234441] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.234578] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.234638] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.234901] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.234993] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.235314] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.235508] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.235508] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.235614] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.235676] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.235857] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.235945] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.236053] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.236220] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.236327] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.236516] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.236675] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.236675] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.236793] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.236864] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.236946] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea is going to be updated. [ 1034.302176] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.302176] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.302176] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.302176] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.302448] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.308756] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-85af6c5e-2f9b-491d-9584-96c44b20f99f taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.308926] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.309034] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.310382] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.310382] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.310382] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.310382] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.310382] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.310382] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.310382] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.310382] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-85af6c5e-2f9b-491d-9584-96c44b20f99f taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.310764] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.310764] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.310764] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.311039] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.311172] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.311276] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.311476] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.311585] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.311697] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.311814] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('85af6c5e-2f9b-491d-9584-96c44b20f99f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.319998] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea in Status: IN_PROGRESS for 2s [ 1034.566971] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2c8ff43e-9a83-418c-851d-179c01ee77a0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.570127] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c8ff43e-9a83-418c-851d-179c01ee77a0 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.570127] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c8ff43e-9a83-418c-851d-179c01ee77a0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.570127] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 65f6a624-226f-4ef4-8088-2f17fe41150d with status ACTIVE [ 1034.570127] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.570127] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.570127] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.570127] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.570127] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.570127] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.570127] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.570127] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.570127] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.571338] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.571338] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.571484] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.571524] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.571752] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.571830] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.571927] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 65f6a624-226f-4ef4-8088-2f17fe41150d is going to be updated. [ 1034.599244] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.599434] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.599505] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.599716] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.599857] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.600049] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-65f6a624-226f-4ef4-8088-2f17fe41150d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.765548] env[65471]: INFO networking_nsxv3.common.synchronization [req-2e2e03ef-efd3-4981-a477-e699cf2db283 req-3425a27a-94fb-4400-bb91-55f4367ffacf tempest-ListImageFiltersTestJSON-417187835 tempest-ListImageFiltersTestJSON-417187835-project-member] Enqueued Resource ID: 2c8ff43e-9a83-418c-851d-179c01ee77a0 with Priority: HIGHEST for action security_group_members [ 1034.765743] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c8ff43e-9a83-418c-851d-179c01ee77a0 with Priority: HIGHEST for action security_group_members [ 1034.766305] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c8ff43e-9a83-418c-851d-179c01ee77a0 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.766437] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c8ff43e-9a83-418c-851d-179c01ee77a0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.817024] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 85af6c5e-2f9b-491d-9584-96c44b20f99f: rpc.has_security_group_logging(os_id): False [ 1034.839190] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.839563] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.839563] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.839670] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.839790] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.840204] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.840402] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.840492] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.840797] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.840797] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.841135] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.841385] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.841486] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.841664] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.842409] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.842736] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.842868] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.843026] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.843217] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.843321] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.843579] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f is going to be updated. [ 1034.936972] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.937141] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.937224] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.937542] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.937687] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.955828] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f in Status: IN_PROGRESS for 2s [ 1035.006069] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e8869e0a-9385-48b2-ac90-589c8415df21 in Status: SUCCESS [ 1035.006429] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.074805] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2c8ff43e-9a83-418c-851d-179c01ee77a0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.079421] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock network-647 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.079649] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "network-647" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.079801] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "network-647" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.081037] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "network-647" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.081037] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.081037] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.081037] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.081324] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.081504] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.082074] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1035.082074] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1035.082074] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1035.082801] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1035.082801] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1035.082801] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1035.082801] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1035.103159] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1035.103379] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1035.103488] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1035.103665] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "network-647" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.103983] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock port-58f05722-2e41-4eaa-bc98-af9240a6f4d2 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.104188] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "port-58f05722-2e41-4eaa-bc98-af9240a6f4d2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.104290] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "port-58f05722-2e41-4eaa-bc98-af9240a6f4d2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.104619] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "port-58f05722-2e41-4eaa-bc98-af9240a6f4d2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.104757] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58f05722-2e41-4eaa-bc98-af9240a6f4d2',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.578742] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.578742] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.578742] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.578742] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.578742] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.579258] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c8ff43e-9a83-418c-851d-179c01ee77a0 is going to be created. [ 1035.602599] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.602802] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.602802] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.603034] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.603201] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.607396] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.607616] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.607758] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.608722] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.608894] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.609076] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Segment Port 58f05722-2e41-4eaa-bc98-af9240a6f4d2 not found, creating... [ 1035.609370] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.609544] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.609667] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.609925] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.610086] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.610396] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.610560] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.610695] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.610924] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.611104] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.611273] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Resource: SegmentPort with ID: 58f05722-2e41-4eaa-bc98-af9240a6f4d2 is going to be created. [ 1035.613452] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c8ff43e-9a83-418c-851d-179c01ee77a0 in Status: UNINITIALIZED for 2s [ 1035.635578] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.636600] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.636600] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.636600] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.636600] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.636600] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "port-58f05722-2e41-4eaa-bc98-af9240a6f4d2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.344553] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea in Status: SUCCESS [ 1036.344854] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.411027] env[65471]: INFO networking_nsxv3.common.synchronization [req-2e2e03ef-efd3-4981-a477-e699cf2db283 req-ac1d0e1f-6350-449f-9d18-b90e207f0b6e service nova] Enqueued Resource ID: 2c8ff43e-9a83-418c-851d-179c01ee77a0 with Priority: HIGHEST for action security_group_rules [ 1036.411227] env[65471]: INFO networking_nsxv3.common.synchronization [req-2e2e03ef-efd3-4981-a477-e699cf2db283 req-ac1d0e1f-6350-449f-9d18-b90e207f0b6e service nova] Enqueued Resource ID: 2c8ff43e-9a83-418c-851d-179c01ee77a0 with Priority: HIGHEST for action security_group_members [ 1036.411368] env[65471]: INFO networking_nsxv3.common.synchronization [req-2e2e03ef-efd3-4981-a477-e699cf2db283 req-ac1d0e1f-6350-449f-9d18-b90e207f0b6e service nova] Enqueued Resource ID: 58f05722-2e41-4eaa-bc98-af9240a6f4d2 with Priority: HIGHEST for action port [ 1036.412172] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c8ff43e-9a83-418c-851d-179c01ee77a0 with Priority: HIGHEST for action security_group_rules [ 1036.412172] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c8ff43e-9a83-418c-851d-179c01ee77a0 with Priority: HIGHEST for action security_group_members [ 1036.412172] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58f05722-2e41-4eaa-bc98-af9240a6f4d2 with Priority: HIGHEST for action port [ 1036.412426] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c8ff43e-9a83-418c-851d-179c01ee77a0 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.412557] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c8ff43e-9a83-418c-851d-179c01ee77a0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.412699] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c8ff43e-9a83-418c-851d-179c01ee77a0 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.412783] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c8ff43e-9a83-418c-851d-179c01ee77a0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.413149] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-58f05722-2e41-4eaa-bc98-af9240a6f4d2 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.413149] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-58f05722-2e41-4eaa-bc98-af9240a6f4d2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.413149] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-58f05722-2e41-4eaa-bc98-af9240a6f4d2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.413344] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-58f05722-2e41-4eaa-bc98-af9240a6f4d2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.413421] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58f05722-2e41-4eaa-bc98-af9240a6f4d2',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.915035] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 58f05722-2e41-4eaa-bc98-af9240a6f4d2 with status ACTIVE [ 1036.915365] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.915437] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.915507] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.915733] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.915827] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.916030] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.916151] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.916215] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.916376] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.916452] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.916633] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.916723] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.916781] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.916914] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.916986] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.917086] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 58f05722-2e41-4eaa-bc98-af9240a6f4d2 is going to be updated. [ 1036.943681] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.943887] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.943887] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.944129] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.944304] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.944428] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-58f05722-2e41-4eaa-bc98-af9240a6f4d2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.970700] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f in Status: SUCCESS [ 1036.970938] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.630644] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c8ff43e-9a83-418c-851d-179c01ee77a0 in Status: SUCCESS [ 1037.630644] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c8ff43e-9a83-418c-851d-179c01ee77a0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.630644] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c8ff43e-9a83-418c-851d-179c01ee77a0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.631032] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c8ff43e-9a83-418c-851d-179c01ee77a0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.631314] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.631460] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.631677] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.631899] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.632154] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.632275] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c8ff43e-9a83-418c-851d-179c01ee77a0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.632404] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2c8ff43e-9a83-418c-851d-179c01ee77a0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.633478] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c8ff43e-9a83-418c-851d-179c01ee77a0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.633709] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c8ff43e-9a83-418c-851d-179c01ee77a0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.633940] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.635148] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.635148] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.635148] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.635148] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.635148] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c8ff43e-9a83-418c-851d-179c01ee77a0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.136438] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c8ff43e-9a83-418c-851d-179c01ee77a0 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.136786] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c8ff43e-9a83-418c-851d-179c01ee77a0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.136786] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2c8ff43e-9a83-418c-851d-179c01ee77a0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.639066] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2c8ff43e-9a83-418c-851d-179c01ee77a0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.143145] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.143497] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.143638] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.144118] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.144599] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.144691] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c8ff43e-9a83-418c-851d-179c01ee77a0 is going to be updated. [ 1039.186675] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.186887] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.186887] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.187755] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.187755] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.199824] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c8ff43e-9a83-418c-851d-179c01ee77a0 in Status: IN_PROGRESS for 2s [ 1041.214399] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c8ff43e-9a83-418c-851d-179c01ee77a0 in Status: IN_PROGRESS for 4s [ 1041.315228] env[65471]: INFO networking_nsxv3.common.synchronization [req-3d6e6311-5e3f-422e-a17c-f6926acdac96 req-978fc493-cb4e-4062-a778-54ad7f854137 tempest-AttachInterfacesTestJSON-1197806586 tempest-AttachInterfacesTestJSON-1197806586-project-member] Enqueued Resource ID: e8869e0a-9385-48b2-ac90-589c8415df21 with Priority: HIGHEST for action security_group_members [ 1041.315883] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8869e0a-9385-48b2-ac90-589c8415df21 with Priority: HIGHEST for action security_group_members [ 1041.316221] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8869e0a-9385-48b2-ac90-589c8415df21 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.316362] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.316428] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.316872] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.316872] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.317404] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.317404] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.317404] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.317404] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.317404] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e8869e0a-9385-48b2-ac90-589c8415df21',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.691716] env[65471]: INFO networking_nsxv3.common.synchronization [req-359ce300-fd6f-42d2-a064-537b13b57351 req-ca865961-d157-4fd9-933a-87869d80b512 tempest-ListServerFiltersTestJSON-1343098391 tempest-ListServerFiltersTestJSON-1343098391-project-member] Enqueued Resource ID: 7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 with Priority: HIGHEST for action security_group_members [ 1041.692296] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 with Priority: HIGHEST for action security_group_members [ 1041.692633] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.692753] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.692814] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.693217] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.693393] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.693498] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.693560] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.693729] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.693815] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.693912] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b0e439e-ae4b-45e5-b678-0ea9b193c6d4',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.820878] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e8869e0a-9385-48b2-ac90-589c8415df21',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.196878] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.196878] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.196878] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.197316] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.197316] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.197389] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.197474] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.197526] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.197723] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.198575] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.198575] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 is going to be updated. [ 1042.229066] env[65471]: INFO networking_nsxv3.common.synchronization [None req-2c7e781f-3239-4553-9a52-0acec5c77dfe tempest-AttachInterfacesTestJSON-1197806586 tempest-AttachInterfacesTestJSON-1197806586-project-member] Enqueued Resource ID: e8869e0a-9385-48b2-ac90-589c8415df21 with Priority: HIGHEST for action security_group_members [ 1042.229911] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8869e0a-9385-48b2-ac90-589c8415df21 with Priority: HIGHEST for action security_group_members [ 1042.230378] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8869e0a-9385-48b2-ac90-589c8415df21 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.230620] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.232479] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.232479] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.232692] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.232906] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.233063] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.243880] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 in Status: IN_PROGRESS for 2s [ 1042.324675] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e8869e0a-9385-48b2-ac90-589c8415df21',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.829462] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.829462] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.829462] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.829462] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.829462] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.829462] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8869e0a-9385-48b2-ac90-589c8415df21 is going to be updated. [ 1042.873110] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.873374] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.873497] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.873822] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.873994] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.884375] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8869e0a-9385-48b2-ac90-589c8415df21 in Status: IN_PROGRESS for 2s [ 1043.225755] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c8ff43e-9a83-418c-851d-179c01ee77a0 in Status: SUCCESS [ 1043.226105] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c8ff43e-9a83-418c-851d-179c01ee77a0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.226368] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c8ff43e-9a83-418c-851d-179c01ee77a0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.226666] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c8ff43e-9a83-418c-851d-179c01ee77a0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.226937] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.227097] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.227185] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.227415] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.228390] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.228390] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c8ff43e-9a83-418c-851d-179c01ee77a0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.731507] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2c8ff43e-9a83-418c-851d-179c01ee77a0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.234697] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2c8ff43e-9a83-418c-851d-179c01ee77a0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.260480] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 in Status: SUCCESS [ 1044.260717] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 deletion is rescheduled due to dependency. [ 1044.260793] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.739602] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.739878] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.739878] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.740244] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.740404] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.740565] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c8ff43e-9a83-418c-851d-179c01ee77a0 is going to be updated. [ 1044.781120] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.781328] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.781412] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.781559] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.781972] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.796948] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c8ff43e-9a83-418c-851d-179c01ee77a0 in Status: IN_PROGRESS for 2s [ 1044.808426] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.808634] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.808708] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.808949] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.809092] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.898203] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8869e0a-9385-48b2-ac90-589c8415df21 in Status: SUCCESS [ 1044.898203] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.898203] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.898203] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.898203] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.898203] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.898203] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.898203] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.898203] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.898203] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e8869e0a-9385-48b2-ac90-589c8415df21',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.088336] env[65471]: INFO networking_nsxv3.common.synchronization [req-a7526ec3-ba46-4d7a-8b27-918710778f7c req-5a3182db-473b-4111-930e-a6b7734f3f10 tempest-AttachInterfacesTestJSON-1197806586 tempest-AttachInterfacesTestJSON-1197806586-project-member] Enqueued Resource ID: c6d2b8aa-4881-48a5-899c-b24d6eb08e70 with Priority: HIGHEST for action security_group_members [ 1045.088336] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6d2b8aa-4881-48a5-899c-b24d6eb08e70 with Priority: HIGHEST for action security_group_members [ 1045.094791] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6d2b8aa-4881-48a5-899c-b24d6eb08e70 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.094791] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6d2b8aa-4881-48a5-899c-b24d6eb08e70" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.094791] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6d2b8aa-4881-48a5-899c-b24d6eb08e70" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.094791] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6d2b8aa-4881-48a5-899c-b24d6eb08e70" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.094791] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.094791] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.094791] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.094791] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.094791] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.094791] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6d2b8aa-4881-48a5-899c-b24d6eb08e70',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.312979] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.406749] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.406749] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.406749] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.406749] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.406749] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.406749] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.406749] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.406749] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.406749] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.406749] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.406749] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8869e0a-9385-48b2-ac90-589c8415df21 is going to be updated. [ 1045.442367] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.442367] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.442367] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.442367] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.442367] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.451049] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8869e0a-9385-48b2-ac90-589c8415df21 in Status: IN_PROGRESS for 2s [ 1045.596258] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.596258] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.596712] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.596712] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.596712] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.596871] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.597282] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.597282] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.597716] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.597716] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.597716] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6d2b8aa-4881-48a5-899c-b24d6eb08e70 is going to be updated. [ 1045.633235] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.633418] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.633459] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.633657] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.633816] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.642768] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6d2b8aa-4881-48a5-899c-b24d6eb08e70 in Status: IN_PROGRESS for 2s [ 1045.814722] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.317387] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1046.318232] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1046.825186] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c8ff43e-9a83-418c-851d-179c01ee77a0 in Status: SUCCESS [ 1046.825931] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c8ff43e-9a83-418c-851d-179c01ee77a0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.825931] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c8ff43e-9a83-418c-851d-179c01ee77a0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.825931] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c8ff43e-9a83-418c-851d-179c01ee77a0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.826324] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.826324] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.826324] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.826658] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.826658] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.826658] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c8ff43e-9a83-418c-851d-179c01ee77a0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.826955] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c8ff43e-9a83-418c-851d-179c01ee77a0 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.826955] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c8ff43e-9a83-418c-851d-179c01ee77a0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.827224] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c8ff43e-9a83-418c-851d-179c01ee77a0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.827224] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c8ff43e-9a83-418c-851d-179c01ee77a0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.827389] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.827503] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.827503] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.827658] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.827731] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.827803] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c8ff43e-9a83-418c-851d-179c01ee77a0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.827880] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2c8ff43e-9a83-418c-851d-179c01ee77a0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.331689] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2c8ff43e-9a83-418c-851d-179c01ee77a0: rpc.has_security_group_logging(os_id): False [ 1047.357888] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.358715] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.358715] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.358715] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.358715] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.358715] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.358983] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.358983] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.358983] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.359090] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.359717] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.359717] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.359717] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.359717] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.359717] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.360262] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.360262] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.360262] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.360262] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.360262] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.360506] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c8ff43e-9a83-418c-851d-179c01ee77a0 is going to be created. [ 1047.428075] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.428075] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.428075] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.428075] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.428364] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.433353] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.437293] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.437414] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.438050] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.456382] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1047.457535] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.459570] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1047.483599] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8869e0a-9385-48b2-ac90-589c8415df21 in Status: SUCCESS [ 1047.483599] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8869e0a-9385-48b2-ac90-589c8415df21 deletion is rescheduled due to dependency. [ 1047.483599] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.487137] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c8ff43e-9a83-418c-851d-179c01ee77a0 in Status: IN_PROGRESS for 2s [ 1047.507766] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.508025] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.508025] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.508269] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.527061] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.527061] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1047.527061] env[65471]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65471) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1047.527061] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1047.605502] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.605685] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.605757] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.605951] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.607675] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.607918] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1047.658174] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6d2b8aa-4881-48a5-899c-b24d6eb08e70 in Status: SUCCESS [ 1047.658384] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6d2b8aa-4881-48a5-899c-b24d6eb08e70 deletion is rescheduled due to dependency. [ 1047.658566] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6d2b8aa-4881-48a5-899c-b24d6eb08e70" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.725047] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.725552] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.725552] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.725726] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.725943] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.726351] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1047.838205] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.838542] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.838542] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.838628] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.838888] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.839215] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:48. [ 1047.839326] env[65471]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'c76874fd-d1f3-4f5c-96ab-39e9f4dcd034', 'a3c5f688-9271-4722-84e9-69667c674933', 'c6d2b8aa-4881-48a5-899c-b24d6eb08e70', '44a00269-8b59-46f1-9a1e-09081fed9489', '735019a1-4315-46a6-b3c7-ec71fdc6ef33', 'b60bf9ef-6e65-4c6d-87e2-33b6bcafa939', '748c6b66-3e73-44a5-8430-c76b55ad8ee3', '6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf', '8c8d67e4-5b19-43b8-b618-1f0b1d72c71a', 'f7dafcbc-15be-4704-ad92-28657ead70aa', '4c8b1bad-5c54-463c-bc01-ad71c5f5f863', '2ecf6012-bc6c-4512-8d9d-962c10f0cad9', 'cd8e3453-8620-4f9d-b764-155e97a20205', 'e4ca8456-5b21-4080-b762-7b52a4837eb1', '2e3bdef3-6800-4bd2-84b8-3ef120fd62f1', 'e7122ab9-4313-4173-8869-cf7cd16cccf0', 'ca7195fd-265e-439f-ac03-4bb1a006981b', '401f7079-c4c2-4951-b6ae-bc1cfbb23228', 'aa1e565f-d426-4783-ad96-ca42d167f6b8', '58316ca3-525d-4197-969c-1e363b6969c6', '57387769-3919-42b1-a3d7-3d45bcef516d', 'b71ce0e0-83fe-4f36-8617-e29f83b0be32', '2a9f3871-1bad-4130-b669-97b85ced692d', '8a168c13-528b-4758-b139-f0aa310cde5c', 'c35d5123-3fe1-447f-aedc-8112e5faa2b6', 'dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6', '7cefc497-117e-45da-bc1f-1ab0ea166d74', 'e8869e0a-9385-48b2-ac90-589c8415df21', '69a8cc18-3d2c-4522-9688-4b5525d659e0', '34e45751-3d11-4d8a-ad9f-272d1ad803fe', 'ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46', '14a38584-d8ef-4361-b344-b91e376144fa', 'bbd99ac4-1db4-4ccf-af90-c6ef33212f88', 'a976012d-6558-47ff-8d35-cffeac52b05f', '0c92cf42-7023-4aba-91c3-95f84d379c9f', '76ee3a37-4552-4528-8f6c-448ca2d9b094', '918bf7c8-0ca6-4052-a0a9-38a8db5664ea', '7b0e439e-ae4b-45e5-b678-0ea9b193c6d4', 'ba1a1760-87f6-4927-9e91-698752fe3531', '2c8ff43e-9a83-418c-851d-179c01ee77a0', 'a70c8576-d6c6-406f-8ebf-d5fb66c56b95', '927a7ac0-117d-4551-a979-a43f61af6c25', '1b605f75-31b8-4209-be69-e1c60e682aa5', '50c2c28e-c8d2-4f9e-a431-6df336da2df5', 'b04574ca-6910-4de6-a76c-d7d90c7e2e0c', '1c8a6eda-c0ec-4e25-8652-6acf3d57da4e', '847d876e-b40b-4d73-9c81-1622676c73b5', '85af6c5e-2f9b-491d-9584-96c44b20f99f'} {{(pid=65471) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1047.839434] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1047.863784] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.864012] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.864012] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.864260] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.864344] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.864457] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1047.864532] env[65471]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65471) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1047.864870] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1047.942542] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.942769] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.942870] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.943150] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.944488] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.944783] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1047.944893] env[65471]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65471) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1047.945015] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1047.945120] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1047.945244] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/48 resources of Type:Security Group Rules [ 1047.945356] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c76874fd-d1f3-4f5c-96ab-39e9f4dcd034 with Priority: HIGH for action security_group_rules [ 1047.945462] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a3c5f688-9271-4722-84e9-69667c674933 with Priority: HIGH for action security_group_rules [ 1047.945566] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c6d2b8aa-4881-48a5-899c-b24d6eb08e70 with Priority: HIGH for action security_group_rules [ 1047.945652] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 44a00269-8b59-46f1-9a1e-09081fed9489 with Priority: HIGH for action security_group_rules [ 1047.945746] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 with Priority: HIGH for action security_group_rules [ 1047.945834] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 with Priority: HIGH for action security_group_rules [ 1047.945920] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 748c6b66-3e73-44a5-8430-c76b55ad8ee3 with Priority: HIGH for action security_group_rules [ 1047.946053] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf with Priority: HIGH for action security_group_rules [ 1047.946149] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8c8d67e4-5b19-43b8-b618-1f0b1d72c71a with Priority: HIGH for action security_group_rules [ 1047.946238] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f7dafcbc-15be-4704-ad92-28657ead70aa with Priority: HIGH for action security_group_rules [ 1047.946322] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4c8b1bad-5c54-463c-bc01-ad71c5f5f863 with Priority: HIGH for action security_group_rules [ 1047.946403] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2ecf6012-bc6c-4512-8d9d-962c10f0cad9 with Priority: HIGH for action security_group_rules [ 1047.946483] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cd8e3453-8620-4f9d-b764-155e97a20205 with Priority: HIGH for action security_group_rules [ 1047.946564] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 with Priority: HIGH for action security_group_rules [ 1047.946645] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2e3bdef3-6800-4bd2-84b8-3ef120fd62f1 with Priority: HIGH for action security_group_rules [ 1047.946745] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e7122ab9-4313-4173-8869-cf7cd16cccf0 with Priority: HIGH for action security_group_rules [ 1047.946806] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ca7195fd-265e-439f-ac03-4bb1a006981b with Priority: HIGH for action security_group_rules [ 1047.946886] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 with Priority: HIGH for action security_group_rules [ 1047.946968] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: aa1e565f-d426-4783-ad96-ca42d167f6b8 with Priority: HIGH for action security_group_rules [ 1047.947066] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 58316ca3-525d-4197-969c-1e363b6969c6 with Priority: HIGH for action security_group_rules [ 1047.947170] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.503817] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c8ff43e-9a83-418c-851d-179c01ee77a0 in Status: SUCCESS [ 1049.504140] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c8ff43e-9a83-418c-851d-179c01ee77a0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.504325] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c8ff43e-9a83-418c-851d-179c01ee77a0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.504591] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c8ff43e-9a83-418c-851d-179c01ee77a0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.504686] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c8ff43e-9a83-418c-851d-179c01ee77a0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.734169] env[65471]: INFO networking_nsxv3.common.synchronization [req-68b31464-f8a9-4766-9739-938732e7cc88 req-70fe262f-9dff-47c7-9868-4b30440afbbc tempest-ImagesTestJSON-650286870 tempest-ImagesTestJSON-650286870-project-member] Enqueued Resource ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f with Priority: HIGHEST for action security_group_members [ 1049.734855] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f with Priority: HIGHEST for action security_group_members [ 1049.735151] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c76874fd-d1f3-4f5c-96ab-39e9f4dcd034 with Priority: HIGH for action security_group_rules [ 1049.735380] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6d2b8aa-4881-48a5-899c-b24d6eb08e70 with Priority: HIGH for action security_group_rules [ 1049.735674] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 748c6b66-3e73-44a5-8430-c76b55ad8ee3 with Priority: HIGH for action security_group_rules [ 1049.735940] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e3bdef3-6800-4bd2-84b8-3ef120fd62f1 with Priority: HIGH for action security_group_rules [ 1049.737028] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58316ca3-525d-4197-969c-1e363b6969c6 with Priority: HIGH for action security_group_rules [ 1049.737028] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa1e565f-d426-4783-ad96-ca42d167f6b8 with Priority: HIGH for action security_group_rules [ 1049.737028] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 with Priority: HIGH for action security_group_rules [ 1049.737028] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca7195fd-265e-439f-ac03-4bb1a006981b with Priority: HIGH for action security_group_rules [ 1049.737028] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 with Priority: HIGH for action security_group_rules [ 1049.737028] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7122ab9-4313-4173-8869-cf7cd16cccf0 with Priority: HIGH for action security_group_rules [ 1049.737028] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd8e3453-8620-4f9d-b764-155e97a20205 with Priority: HIGH for action security_group_rules [ 1049.737028] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ecf6012-bc6c-4512-8d9d-962c10f0cad9 with Priority: HIGH for action security_group_rules [ 1049.737028] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c8b1bad-5c54-463c-bc01-ad71c5f5f863 with Priority: HIGH for action security_group_rules [ 1049.737028] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7dafcbc-15be-4704-ad92-28657ead70aa with Priority: HIGH for action security_group_rules [ 1049.737455] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c8d67e4-5b19-43b8-b618-1f0b1d72c71a with Priority: HIGH for action security_group_rules [ 1049.737455] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 with Priority: HIGH for action security_group_rules [ 1049.737455] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf with Priority: HIGH for action security_group_rules [ 1049.737455] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 with Priority: HIGH for action security_group_rules [ 1049.737455] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3c5f688-9271-4722-84e9-69667c674933 with Priority: HIGH for action security_group_rules [ 1049.737809] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44a00269-8b59-46f1-9a1e-09081fed9489 with Priority: HIGH for action security_group_rules [ 1049.737848] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-85af6c5e-2f9b-491d-9584-96c44b20f99f taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.738660] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.738660] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.738660] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.738660] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.738660] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.738660] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.738660] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.739021] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.739021] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85af6c5e-2f9b-491d-9584-96c44b20f99f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.740216] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c76874fd-d1f3-4f5c-96ab-39e9f4dcd034 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.740309] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c76874fd-d1f3-4f5c-96ab-39e9f4dcd034" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.740891] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c76874fd-d1f3-4f5c-96ab-39e9f4dcd034" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.740891] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c76874fd-d1f3-4f5c-96ab-39e9f4dcd034" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.740891] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c76874fd-d1f3-4f5c-96ab-39e9f4dcd034',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.741409] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c6d2b8aa-4881-48a5-899c-b24d6eb08e70 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.741990] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c6d2b8aa-4881-48a5-899c-b24d6eb08e70" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.741990] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c6d2b8aa-4881-48a5-899c-b24d6eb08e70" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.741990] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c6d2b8aa-4881-48a5-899c-b24d6eb08e70" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.741990] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c6d2b8aa-4881-48a5-899c-b24d6eb08e70',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.742704] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-748c6b66-3e73-44a5-8430-c76b55ad8ee3 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.742816] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-748c6b66-3e73-44a5-8430-c76b55ad8ee3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.742882] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-748c6b66-3e73-44a5-8430-c76b55ad8ee3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.743807] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-748c6b66-3e73-44a5-8430-c76b55ad8ee3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.743872] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('748c6b66-3e73-44a5-8430-c76b55ad8ee3',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.744929] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.745078] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.745147] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.745298] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.745371] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2e3bdef3-6800-4bd2-84b8-3ef120fd62f1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.746423] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-58316ca3-525d-4197-969c-1e363b6969c6 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.746535] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-58316ca3-525d-4197-969c-1e363b6969c6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.746601] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-58316ca3-525d-4197-969c-1e363b6969c6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.746745] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-58316ca3-525d-4197-969c-1e363b6969c6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.746817] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('58316ca3-525d-4197-969c-1e363b6969c6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.747916] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa1e565f-d426-4783-ad96-ca42d167f6b8 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.748020] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa1e565f-d426-4783-ad96-ca42d167f6b8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.748093] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa1e565f-d426-4783-ad96-ca42d167f6b8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.748266] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa1e565f-d426-4783-ad96-ca42d167f6b8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.748342] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa1e565f-d426-4783-ad96-ca42d167f6b8',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.749294] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-401f7079-c4c2-4951-b6ae-bc1cfbb23228 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.749606] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.749663] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.749784] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.749857] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('401f7079-c4c2-4951-b6ae-bc1cfbb23228',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.751065] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca7195fd-265e-439f-ac03-4bb1a006981b taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.751138] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca7195fd-265e-439f-ac03-4bb1a006981b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.751245] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca7195fd-265e-439f-ac03-4bb1a006981b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.751398] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca7195fd-265e-439f-ac03-4bb1a006981b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.751471] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca7195fd-265e-439f-ac03-4bb1a006981b',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.752539] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e4ca8456-5b21-4080-b762-7b52a4837eb1 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.752681] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.753244] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.753244] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.753244] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e4ca8456-5b21-4080-b762-7b52a4837eb1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.754487] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e7122ab9-4313-4173-8869-cf7cd16cccf0 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.754595] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e7122ab9-4313-4173-8869-cf7cd16cccf0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.754788] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e7122ab9-4313-4173-8869-cf7cd16cccf0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.754923] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e7122ab9-4313-4173-8869-cf7cd16cccf0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.755016] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e7122ab9-4313-4173-8869-cf7cd16cccf0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.755692] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd8e3453-8620-4f9d-b764-155e97a20205 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.755797] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd8e3453-8620-4f9d-b764-155e97a20205" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.755864] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd8e3453-8620-4f9d-b764-155e97a20205" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.756021] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd8e3453-8620-4f9d-b764-155e97a20205" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.756826] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd8e3453-8620-4f9d-b764-155e97a20205',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.759764] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ecf6012-bc6c-4512-8d9d-962c10f0cad9 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.759914] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.759984] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.760262] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.760367] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ecf6012-bc6c-4512-8d9d-962c10f0cad9',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.761064] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c8b1bad-5c54-463c-bc01-ad71c5f5f863 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.761507] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c8b1bad-5c54-463c-bc01-ad71c5f5f863" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.761631] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c8b1bad-5c54-463c-bc01-ad71c5f5f863" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.761760] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c8b1bad-5c54-463c-bc01-ad71c5f5f863" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.761836] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c8b1bad-5c54-463c-bc01-ad71c5f5f863',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.763857] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7dafcbc-15be-4704-ad92-28657ead70aa taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.763857] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.763857] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.763857] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.763857] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7dafcbc-15be-4704-ad92-28657ead70aa',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.768395] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c8d67e4-5b19-43b8-b618-1f0b1d72c71a taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.768395] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c8d67e4-5b19-43b8-b618-1f0b1d72c71a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.768395] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c8d67e4-5b19-43b8-b618-1f0b1d72c71a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.768395] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c8d67e4-5b19-43b8-b618-1f0b1d72c71a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.768395] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c8d67e4-5b19-43b8-b618-1f0b1d72c71a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.768395] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.768395] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.768395] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.768395] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.768395] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b60bf9ef-6e65-4c6d-87e2-33b6bcafa939',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.768395] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.768395] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.768395] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.768395] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.768395] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.768395] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-735019a1-4315-46a6-b3c7-ec71fdc6ef33 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.768395] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.768395] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.769144] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.769144] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.770341] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a3c5f688-9271-4722-84e9-69667c674933 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.770460] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.770644] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.770799] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.770878] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a3c5f688-9271-4722-84e9-69667c674933',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.772403] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-44a00269-8b59-46f1-9a1e-09081fed9489 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.772403] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-44a00269-8b59-46f1-9a1e-09081fed9489" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.772403] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-44a00269-8b59-46f1-9a1e-09081fed9489" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.772403] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-44a00269-8b59-46f1-9a1e-09081fed9489" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.772648] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('44a00269-8b59-46f1-9a1e-09081fed9489',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.803113] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.803287] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.803359] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.803661] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.826235] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.826235] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c76874fd-d1f3-4f5c-96ab-39e9f4dcd034 is going to be deleted. [ 1049.880054] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.880232] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.880305] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.880613] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.880613] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.880756] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c76874fd-d1f3-4f5c-96ab-39e9f4dcd034" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.006913] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c8ff43e-9a83-418c-851d-179c01ee77a0 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.007061] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c8ff43e-9a83-418c-851d-179c01ee77a0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.007061] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c8ff43e-9a83-418c-851d-179c01ee77a0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.007301] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c8ff43e-9a83-418c-851d-179c01ee77a0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.007471] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.007573] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.007627] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.007782] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.007864] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.007948] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c8ff43e-9a83-418c-851d-179c01ee77a0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.008059] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2c8ff43e-9a83-418c-851d-179c01ee77a0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.151348] env[65471]: INFO networking_nsxv3.common.synchronization [None req-a8bed2c0-585e-490d-a3c9-37d6d804c109 tempest-ServerRescueNegativeTestJSON-1570103274 tempest-ServerRescueNegativeTestJSON-1570103274-project-member] Enqueued Resource ID: 6d51d32d-beb9-4c26-b877-a2c1a68caa39 with Priority: HIGHEST for action security_group_rules [ 1050.151348] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d51d32d-beb9-4c26-b877-a2c1a68caa39 with Priority: HIGHEST for action security_group_rules [ 1050.151348] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d51d32d-beb9-4c26-b877-a2c1a68caa39 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.151348] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d51d32d-beb9-4c26-b877-a2c1a68caa39" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.151348] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d51d32d-beb9-4c26-b877-a2c1a68caa39" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.151348] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d51d32d-beb9-4c26-b877-a2c1a68caa39" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.151348] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d51d32d-beb9-4c26-b877-a2c1a68caa39',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.241627] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.243277] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.243277] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.243461] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.255071] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-401f7079-c4c2-4951-b6ae-bc1cfbb23228 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.255071] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.255071] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.255071] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.255071] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.255071] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.255071] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.255071] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.255071] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.255071] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.255071] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('401f7079-c4c2-4951-b6ae-bc1cfbb23228',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.266364] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.266624] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.266741] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.266804] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.267013] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.267110] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.267748] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f is going to be updated. [ 1050.268840] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.268964] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.269042] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.269223] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.271925] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-735019a1-4315-46a6-b3c7-ec71fdc6ef33 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.271925] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.271925] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.272199] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.272391] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.272524] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.272616] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.272799] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.272916] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.273397] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.273397] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.275065] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7dafcbc-15be-4704-ad92-28657ead70aa taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.275312] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.275492] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.275707] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.275907] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.276326] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.276460] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.276653] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.276770] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.276889] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.277016] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f7dafcbc-15be-4704-ad92-28657ead70aa',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.284709] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.284873] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.284873] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.285167] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.285412] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.285542] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.285633] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.285834] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.285956] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.286100] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.286250] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2e3bdef3-6800-4bd2-84b8-3ef120fd62f1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.296036] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-748c6b66-3e73-44a5-8430-c76b55ad8ee3 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.296036] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-748c6b66-3e73-44a5-8430-c76b55ad8ee3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.296036] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-748c6b66-3e73-44a5-8430-c76b55ad8ee3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.296036] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-748c6b66-3e73-44a5-8430-c76b55ad8ee3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.296036] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.296036] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.296036] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.296036] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.296036] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.296036] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-748c6b66-3e73-44a5-8430-c76b55ad8ee3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.296036] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('748c6b66-3e73-44a5-8430-c76b55ad8ee3',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.296674] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c8d67e4-5b19-43b8-b618-1f0b1d72c71a taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.296726] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c8d67e4-5b19-43b8-b618-1f0b1d72c71a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.296831] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c8d67e4-5b19-43b8-b618-1f0b1d72c71a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.297626] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c8d67e4-5b19-43b8-b618-1f0b1d72c71a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.297626] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.297626] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.297626] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.297626] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.297626] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.297626] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c8d67e4-5b19-43b8-b618-1f0b1d72c71a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.298014] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8c8d67e4-5b19-43b8-b618-1f0b1d72c71a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.303611] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.304764] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.310640] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.310836] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58316ca3-525d-4197-969c-1e363b6969c6 is going to be deleted. [ 1050.317927] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.318061] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.318160] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.318406] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.321564] env[65471]: INFO networking_nsxv3.common.synchronization [None req-93715c66-a48a-467d-8111-7a3e0b17a1f9 tempest-ServerRescueNegativeTestJSON-1570103274 tempest-ServerRescueNegativeTestJSON-1570103274-project-member] Enqueued Resource ID: 6d51d32d-beb9-4c26-b877-a2c1a68caa39 with Priority: HIGHEST for action security_group_rules [ 1050.327221] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.327447] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.328884] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.329228] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.329228] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.330031] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.330031] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.332098] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d51d32d-beb9-4c26-b877-a2c1a68caa39 with Priority: HIGHEST for action security_group_rules [ 1050.341304] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d51d32d-beb9-4c26-b877-a2c1a68caa39 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.341492] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d51d32d-beb9-4c26-b877-a2c1a68caa39" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.366020] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f in Status: IN_PROGRESS for 2s [ 1050.370322] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.370535] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.371949] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.372327] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.373105] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.373287] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.374204] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.374319] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.375105] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.375257] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.376034] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.376179] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.376983] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.377278] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e4ca8456-5b21-4080-b762-7b52a4837eb1 is going to be deleted. [ 1050.379148] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.379239] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.379376] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.379627] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.381307] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.381486] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.382126] env[65471]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1050.382666] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.382857] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.411222] env[65471]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1050.411813] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.411963] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ecf6012-bc6c-4512-8d9d-962c10f0cad9 is going to be deleted. [ 1050.413030] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.413281] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.417883] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.418048] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.434951] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.435108] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.436056] env[65471]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1050.436554] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.436826] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c8b1bad-5c54-463c-bc01-ad71c5f5f863 is going to be deleted. [ 1050.437636] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.437858] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.464112] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.464241] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa1e565f-d426-4783-ad96-ca42d167f6b8 is going to be deleted. [ 1050.465380] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.465627] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.480754] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.480986] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.485781] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.486090] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf is going to be deleted. [ 1050.486951] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.487538] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.510448] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c8ff43e-9a83-418c-851d-179c01ee77a0 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.510448] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c8ff43e-9a83-418c-851d-179c01ee77a0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.510907] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c8ff43e-9a83-418c-851d-179c01ee77a0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.510907] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c8ff43e-9a83-418c-851d-179c01ee77a0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.510980] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.511075] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.511166] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.511347] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.511455] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.511537] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c8ff43e-9a83-418c-851d-179c01ee77a0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.511709] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c8ff43e-9a83-418c-851d-179c01ee77a0 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.512108] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c8ff43e-9a83-418c-851d-179c01ee77a0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.512197] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c8ff43e-9a83-418c-851d-179c01ee77a0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.512363] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c8ff43e-9a83-418c-851d-179c01ee77a0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.512527] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.512630] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.512693] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.512838] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.512981] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.513027] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c8ff43e-9a83-418c-851d-179c01ee77a0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.513095] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2c8ff43e-9a83-418c-851d-179c01ee77a0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.551987] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.552210] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.553248] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.553382] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e7122ab9-4313-4173-8869-cf7cd16cccf0 is going to be deleted. [ 1050.554492] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.554720] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.609157] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.609409] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.610898] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.611109] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 44a00269-8b59-46f1-9a1e-09081fed9489 is going to be deleted. [ 1050.613033] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.613033] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.615609] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.615769] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.656849] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.657195] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd8e3453-8620-4f9d-b764-155e97a20205 is going to be deleted. [ 1050.657945] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.658203] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.718657] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.718885] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.720803] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.721052] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.731561] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.732159] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b60bf9ef-6e65-4c6d-87e2-33b6bcafa939 is going to be deleted. [ 1050.732692] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.732958] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.742226] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.742321] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.757892] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('401f7079-c4c2-4951-b6ae-bc1cfbb23228',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.785946] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f7dafcbc-15be-4704-ad92-28657ead70aa',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.787076] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-735019a1-4315-46a6-b3c7-ec71fdc6ef33 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.787318] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.787407] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.787645] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.788571] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.788692] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.788758] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.788949] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.789053] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.789148] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.789321] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-735019a1-4315-46a6-b3c7-ec71fdc6ef33 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.789416] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.789474] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.789639] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.789779] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.789869] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.790075] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.790075] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.790193] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.793023] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.793023] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.796889] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.797053] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c6d2b8aa-4881-48a5-899c-b24d6eb08e70 is going to be deleted. [ 1050.798138] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.798372] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.800320] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.800495] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.805880] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8c8d67e4-5b19-43b8-b618-1f0b1d72c71a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.814173] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('748c6b66-3e73-44a5-8430-c76b55ad8ee3',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.817312] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.817451] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.817518] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.817765] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.817938] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.818050] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.818109] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.818266] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.819671] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.819671] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.819671] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.819671] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.819671] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.819671] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.819671] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.819671] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.819671] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.819671] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.819671] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.819671] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.820404] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2e3bdef3-6800-4bd2-84b8-3ef120fd62f1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.884291] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.884473] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a3c5f688-9271-4722-84e9-69667c674933 is going to be deleted. [ 1050.885547] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.885837] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.934696] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.934921] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca7195fd-265e-439f-ac03-4bb1a006981b is going to be deleted. [ 1050.936288] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.936288] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.936288] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.936460] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-58316ca3-525d-4197-969c-1e363b6969c6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.936639] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.936831] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.936933] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.937124] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e4ca8456-5b21-4080-b762-7b52a4837eb1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.937790] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.938041] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.938188] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.938350] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ecf6012-bc6c-4512-8d9d-962c10f0cad9" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.938810] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.938810] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.938906] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.938994] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c8b1bad-5c54-463c-bc01-ad71c5f5f863" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.939152] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.939374] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.939506] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.939688] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c3f1ccd-7dc2-48cd-be18-1f69e6eaf7bf" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.939838] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.940054] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.940170] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.940509] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa1e565f-d426-4783-ad96-ca42d167f6b8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.940636] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.940765] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.940883] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.941095] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e7122ab9-4313-4173-8869-cf7cd16cccf0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.941344] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.941529] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.941568] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.941701] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d51d32d-beb9-4c26-b877-a2c1a68caa39 already deleted. [ 1050.941832] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d51d32d-beb9-4c26-b877-a2c1a68caa39" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.942043] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.942306] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.942391] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.942735] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-44a00269-8b59-46f1-9a1e-09081fed9489" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.942841] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d51d32d-beb9-4c26-b877-a2c1a68caa39" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.944188] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d51d32d-beb9-4c26-b877-a2c1a68caa39" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.944188] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d51d32d-beb9-4c26-b877-a2c1a68caa39',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.945207] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.945207] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.945207] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.945207] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd8e3453-8620-4f9d-b764-155e97a20205" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.014852] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2c8ff43e-9a83-418c-851d-179c01ee77a0: rpc.has_security_group_logging(os_id): False [ 1051.021674] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.021826] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.021908] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.022173] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.022213] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.022329] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b60bf9ef-6e65-4c6d-87e2-33b6bcafa939" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.048840] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.049094] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.049223] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.049758] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.051365] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.051516] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.053486] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.053486] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.096839] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.097420] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.097420] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.097420] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.097660] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.097660] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.097986] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.097986] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.098085] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.098190] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.098343] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.098893] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.098893] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.098893] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.098893] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.098893] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.098893] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c8ff43e-9a83-418c-851d-179c01ee77a0 is going to be updated. [ 1051.099947] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.100127] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.100213] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.100326] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c6d2b8aa-4881-48a5-899c-b24d6eb08e70" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.100463] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.100611] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.100685] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.100794] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a3c5f688-9271-4722-84e9-69667c674933" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.121463] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.121750] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.121750] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.122040] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.122091] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.122638] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca7195fd-265e-439f-ac03-4bb1a006981b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.254420] env[65471]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1051.255064] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.255213] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.255284] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.255582] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.255755] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.262671] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 401f7079-c4c2-4951-b6ae-bc1cfbb23228: rpc.has_security_group_logging(os_id): False [ 1051.292758] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f7dafcbc-15be-4704-ad92-28657ead70aa: rpc.has_security_group_logging(os_id): False [ 1051.294860] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 735019a1-4315-46a6-b3c7-ec71fdc6ef33: rpc.has_security_group_logging(os_id): False [ 1051.308853] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8c8d67e4-5b19-43b8-b618-1f0b1d72c71a: rpc.has_security_group_logging(os_id): False [ 1051.316413] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 748c6b66-3e73-44a5-8430-c76b55ad8ee3: rpc.has_security_group_logging(os_id): False [ 1051.324025] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2e3bdef3-6800-4bd2-84b8-3ef120fd62f1: rpc.has_security_group_logging(os_id): False [ 1051.331781] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.331937] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.332021] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.332237] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.354766] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c8ff43e-9a83-418c-851d-179c01ee77a0 in Status: IN_PROGRESS for 2s [ 1051.358532] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.358684] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.359566] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.359805] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.366764] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.366883] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.379791] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.380154] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.380251] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.380333] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.380526] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.380612] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.380815] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 is going to be updated. [ 1051.381913] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.383494] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.422670] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.422670] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.449934] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.451048] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.456243] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.456588] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.456691] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.456774] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.457022] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.457128] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.457205] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7dafcbc-15be-4704-ad92-28657ead70aa is going to be updated. [ 1051.458569] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.458790] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.498104] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.498978] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.512107] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.512633] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.512633] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.512633] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.512923] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.512989] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.513607] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.513607] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.513607] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.513845] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.513845] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.513982] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.514960] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.514960] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.514960] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.514960] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.514960] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 is going to be updated. [ 1051.515951] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.516137] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.544532] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.544925] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.545102] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.545183] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.545431] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.545674] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.545870] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.546024] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.546079] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.546318] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.546408] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.546637] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.546731] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.546811] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.547109] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.547109] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.547342] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2e3bdef3-6800-4bd2-84b8-3ef120fd62f1 is going to be updated. [ 1051.548467] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.548687] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.581650] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.581650] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.581863] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.581863] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.581978] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.582067] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.582173] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c8d67e4-5b19-43b8-b618-1f0b1d72c71a is going to be updated. [ 1051.583349] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.583520] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.592570] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.592927] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.599704] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.599927] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.646193] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.646621] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.646733] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.646782] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.647013] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.647130] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.647264] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 748c6b66-3e73-44a5-8430-c76b55ad8ee3 is going to be updated. [ 1051.649245] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.649483] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.649580] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.649682] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d51d32d-beb9-4c26-b877-a2c1a68caa39 already deleted. [ 1051.649852] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d51d32d-beb9-4c26-b877-a2c1a68caa39" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.649917] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.650080] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.650212] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.651305] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.651478] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.651611] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.703024] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.703276] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.703371] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.703627] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.703812] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.723910] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.724214] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.724214] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.724435] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.724619] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.726475] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7dafcbc-15be-4704-ad92-28657ead70aa in Status: IN_PROGRESS for 2s [ 1051.727504] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 in Status: IN_PROGRESS for 2s [ 1051.735858] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.736164] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.736164] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.736276] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.736475] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.745383] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 in Status: IN_PROGRESS for 2s [ 1051.749777] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2e3bdef3-6800-4bd2-84b8-3ef120fd62f1 in Status: IN_PROGRESS for 2s [ 1051.804687] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c8d67e4-5b19-43b8-b618-1f0b1d72c71a in Status: IN_PROGRESS for 2s [ 1051.843791] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.843791] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.843791] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.843791] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.843791] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.904174] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 748c6b66-3e73-44a5-8430-c76b55ad8ee3 in Status: IN_PROGRESS for 2s [ 1052.176148] env[65471]: INFO networking_nsxv3.common.synchronization [req-b27031b1-effa-4dd0-a1ff-57e8c48dac23 req-31a77342-2b48-454d-b941-ab52af593071 tempest-MultipleCreateTestJSON-1803706331 tempest-MultipleCreateTestJSON-1803706331-project-member] Enqueued Resource ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe with Priority: HIGHEST for action security_group_members [ 1052.176729] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe with Priority: HIGHEST for action security_group_members [ 1052.177089] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-34e45751-3d11-4d8a-ad9f-272d1ad803fe taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.177224] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.177301] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.177503] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.177888] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.177888] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.177888] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.178047] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.178086] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.178414] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34e45751-3d11-4d8a-ad9f-272d1ad803fe',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.379755] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f in Status: SUCCESS [ 1052.380017] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85af6c5e-2f9b-491d-9584-96c44b20f99f deletion is rescheduled due to dependency. [ 1052.380166] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85af6c5e-2f9b-491d-9584-96c44b20f99f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.574299] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock network-151 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.574639] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "network-151" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.574724] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "network-151" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.575014] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "network-151" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.575313] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.575504] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.575672] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.575858] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.575998] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.576262] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1052.576396] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1052.576505] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1052.576627] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1052.576736] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1052.576862] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1052.577022] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1052.598308] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1052.598494] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1052.598677] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1052.598859] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "network-151" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.599191] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock port-c602c9e4-57ad-43ef-846d-4a7d9fcb613d taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.599365] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "port-c602c9e4-57ad-43ef-846d-4a7d9fcb613d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.599583] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "port-c602c9e4-57ad-43ef-846d-4a7d9fcb613d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.599970] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "port-c602c9e4-57ad-43ef-846d-4a7d9fcb613d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.600247] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c602c9e4-57ad-43ef-846d-4a7d9fcb613d',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.681668] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.681832] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.681902] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.682165] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.705561] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.705976] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.705976] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.706111] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.706226] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.706312] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.706407] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe is going to be updated. [ 1052.735290] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.735528] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.735624] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.735948] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.736181] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.747171] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe in Status: IN_PROGRESS for 2s [ 1053.102582] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.103107] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.103956] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.104318] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.104460] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.104622] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Segment Port c602c9e4-57ad-43ef-846d-4a7d9fcb613d not found, creating... [ 1053.104902] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.105078] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.105197] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.105421] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.105559] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.105849] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.106009] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.106133] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.106338] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.106475] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.106613] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Resource: SegmentPort with ID: c602c9e4-57ad-43ef-846d-4a7d9fcb613d is going to be created. [ 1053.130498] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.130739] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.130952] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.131323] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.131614] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.131885] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "port-c602c9e4-57ad-43ef-846d-4a7d9fcb613d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.371727] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c8ff43e-9a83-418c-851d-179c01ee77a0 in Status: SUCCESS [ 1053.371727] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c8ff43e-9a83-418c-851d-179c01ee77a0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.742855] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 in Status: SUCCESS [ 1053.743145] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.743924] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7dafcbc-15be-4704-ad92-28657ead70aa in Status: SUCCESS [ 1053.744118] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.760737] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 in Status: SUCCESS [ 1053.760737] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.762409] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2e3bdef3-6800-4bd2-84b8-3ef120fd62f1 in Status: SUCCESS [ 1053.762607] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.841554] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c8d67e4-5b19-43b8-b618-1f0b1d72c71a in Status: SUCCESS [ 1053.841832] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c8d67e4-5b19-43b8-b618-1f0b1d72c71a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.846356] env[65471]: INFO networking_nsxv3.common.synchronization [req-b27031b1-effa-4dd0-a1ff-57e8c48dac23 req-7f304afa-70f2-4e1b-9558-5305b8ffc361 service nova] Enqueued Resource ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe with Priority: HIGHEST for action security_group_rules [ 1053.846600] env[65471]: INFO networking_nsxv3.common.synchronization [req-b27031b1-effa-4dd0-a1ff-57e8c48dac23 req-7f304afa-70f2-4e1b-9558-5305b8ffc361 service nova] Enqueued Resource ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe with Priority: HIGHEST for action security_group_members [ 1053.846828] env[65471]: INFO networking_nsxv3.common.synchronization [req-b27031b1-effa-4dd0-a1ff-57e8c48dac23 req-7f304afa-70f2-4e1b-9558-5305b8ffc361 service nova] Enqueued Resource ID: c602c9e4-57ad-43ef-846d-4a7d9fcb613d with Priority: HIGHEST for action port [ 1053.847532] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe with Priority: HIGHEST for action security_group_rules [ 1053.847870] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe with Priority: HIGHEST for action security_group_members [ 1053.847870] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c602c9e4-57ad-43ef-846d-4a7d9fcb613d with Priority: HIGHEST for action port [ 1053.848232] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34e45751-3d11-4d8a-ad9f-272d1ad803fe taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.848377] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.848440] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.848665] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.848747] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34e45751-3d11-4d8a-ad9f-272d1ad803fe',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.849740] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-34e45751-3d11-4d8a-ad9f-272d1ad803fe taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.849846] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.850148] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-c602c9e4-57ad-43ef-846d-4a7d9fcb613d taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.850269] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c602c9e4-57ad-43ef-846d-4a7d9fcb613d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.850355] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c602c9e4-57ad-43ef-846d-4a7d9fcb613d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.850534] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c602c9e4-57ad-43ef-846d-4a7d9fcb613d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.850647] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c602c9e4-57ad-43ef-846d-4a7d9fcb613d',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.934607] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 748c6b66-3e73-44a5-8430-c76b55ad8ee3 in Status: SUCCESS [ 1053.934607] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-748c6b66-3e73-44a5-8430-c76b55ad8ee3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.352865] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-34e45751-3d11-4d8a-ad9f-272d1ad803fe taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.353020] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.353285] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c602c9e4-57ad-43ef-846d-4a7d9fcb613d with status ACTIVE [ 1054.353474] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.353803] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.353891] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.354106] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.354204] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.354469] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.354578] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.354639] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.354814] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.355192] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.355192] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.355461] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.355461] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.355461] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.355556] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.355612] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c602c9e4-57ad-43ef-846d-4a7d9fcb613d is going to be updated. [ 1054.384542] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.384542] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.384542] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.385039] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.385039] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.385110] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c602c9e4-57ad-43ef-846d-4a7d9fcb613d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.571693] env[65471]: INFO networking_nsxv3.common.synchronization [req-b27031b1-effa-4dd0-a1ff-57e8c48dac23 req-8e8fa04b-ae8d-4b0c-986d-9462eefceeff tempest-MultipleCreateTestJSON-1803706331 tempest-MultipleCreateTestJSON-1803706331-project-member] Enqueued Resource ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe with Priority: HIGHEST for action security_group_members [ 1054.572760] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe with Priority: HIGHEST for action security_group_members [ 1054.573073] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-34e45751-3d11-4d8a-ad9f-272d1ad803fe taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.573182] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.760215] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe in Status: SUCCESS [ 1054.760652] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe deletion is rescheduled due to dependency. [ 1054.760652] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.760787] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.760901] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.761124] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.761268] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.761268] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.761472] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.761533] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.761602] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34e45751-3d11-4d8a-ad9f-272d1ad803fe',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.958781] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock network-151 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.959058] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "network-151" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.959151] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "network-151" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.959391] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "network-151" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.959663] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.959914] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.960053] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.960279] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.960426] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.960636] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1054.960746] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1054.960851] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1054.960957] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1054.961074] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1054.961176] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1054.961307] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1054.981343] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1054.981512] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1054.981649] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1054.981821] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "network-151" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.982160] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock port-191bd046-dc15-4619-9b2a-70934bed5686 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.982364] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "port-191bd046-dc15-4619-9b2a-70934bed5686" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.982486] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "port-191bd046-dc15-4619-9b2a-70934bed5686" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.982811] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "port-191bd046-dc15-4619-9b2a-70934bed5686" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.982945] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('191bd046-dc15-4619-9b2a-70934bed5686',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.264948] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('34e45751-3d11-4d8a-ad9f-272d1ad803fe',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.485259] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.485758] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.485918] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.486312] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.486478] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.486628] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Segment Port 191bd046-dc15-4619-9b2a-70934bed5686 not found, creating... [ 1055.486912] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.487120] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.487217] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.487457] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.487596] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.487919] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.488114] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.488235] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.488455] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.488596] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.488740] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Resource: SegmentPort with ID: 191bd046-dc15-4619-9b2a-70934bed5686 is going to be created. [ 1055.510397] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.510685] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.510827] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.511133] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.511572] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.511668] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "port-191bd046-dc15-4619-9b2a-70934bed5686" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.769777] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('34e45751-3d11-4d8a-ad9f-272d1ad803fe',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.270602] env[65471]: INFO networking_nsxv3.common.synchronization [req-b27031b1-effa-4dd0-a1ff-57e8c48dac23 req-97c5d4fd-a01f-44e0-8c9e-634912bb7b52 service nova] Enqueued Resource ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe with Priority: HIGHEST for action security_group_rules [ 1056.270796] env[65471]: INFO networking_nsxv3.common.synchronization [req-b27031b1-effa-4dd0-a1ff-57e8c48dac23 req-97c5d4fd-a01f-44e0-8c9e-634912bb7b52 service nova] Enqueued Resource ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe with Priority: HIGHEST for action security_group_members [ 1056.270968] env[65471]: INFO networking_nsxv3.common.synchronization [req-b27031b1-effa-4dd0-a1ff-57e8c48dac23 req-97c5d4fd-a01f-44e0-8c9e-634912bb7b52 service nova] Enqueued Resource ID: 191bd046-dc15-4619-9b2a-70934bed5686 with Priority: HIGHEST for action port [ 1056.271546] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe with Priority: HIGHEST for action security_group_rules [ 1056.271718] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe with Priority: HIGHEST for action security_group_members [ 1056.271871] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 191bd046-dc15-4619-9b2a-70934bed5686 with Priority: HIGHEST for action port [ 1056.272254] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.272408] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.272446] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.272631] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.272956] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.272956] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe is going to be updated. [ 1056.274078] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34e45751-3d11-4d8a-ad9f-272d1ad803fe taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.274189] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.274378] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-34e45751-3d11-4d8a-ad9f-272d1ad803fe taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.274464] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.274671] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-191bd046-dc15-4619-9b2a-70934bed5686 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.274753] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-191bd046-dc15-4619-9b2a-70934bed5686" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.274816] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-191bd046-dc15-4619-9b2a-70934bed5686" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.274981] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-191bd046-dc15-4619-9b2a-70934bed5686" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.275071] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('191bd046-dc15-4619-9b2a-70934bed5686',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.307891] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.308206] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.308206] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.308338] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.308505] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.318384] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe in Status: IN_PROGRESS for 2s [ 1056.778289] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 191bd046-dc15-4619-9b2a-70934bed5686 with status ACTIVE [ 1056.778533] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.778683] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.778725] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.778949] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.779047] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.779258] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.779320] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.779388] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.779730] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.779730] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.779809] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.779866] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.780134] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.780134] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.780134] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.780243] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 191bd046-dc15-4619-9b2a-70934bed5686 is going to be updated. [ 1056.802309] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.802452] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.802526] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.802739] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.802871] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.803118] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-191bd046-dc15-4619-9b2a-70934bed5686" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.053388] env[65471]: INFO networking_nsxv3.common.synchronization [req-7ea1bb78-3abb-41d6-a9d9-828fa0e3f027 req-79ec140d-ac7c-414b-a61b-1551f48bfc90 tempest-ServersTestJSON-569130442 tempest-ServersTestJSON-569130442-project-member] Enqueued Resource ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 with Priority: HIGHEST for action security_group_members [ 1057.054015] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 with Priority: HIGHEST for action security_group_members [ 1057.054442] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-735019a1-4315-46a6-b3c7-ec71fdc6ef33 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.054596] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.054674] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.054859] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.055356] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.055510] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.055579] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.055787] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.055902] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.056038] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.454373] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock network-92 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.454784] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "network-92" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.454938] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "network-92" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.455340] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "network-92" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.455651] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.455806] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.455954] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.456254] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.456406] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.456627] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1057.456781] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1057.456929] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1057.457057] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1057.457215] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1057.457388] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1057.457623] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1057.481882] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1057.482092] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1057.482256] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1057.482515] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "network-92" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.482847] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock port-a133a4af-0e8c-4929-b07b-b8c575afc960 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.483064] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "port-a133a4af-0e8c-4929-b07b-b8c575afc960" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.483211] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "port-a133a4af-0e8c-4929-b07b-b8c575afc960" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.483589] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "port-a133a4af-0e8c-4929-b07b-b8c575afc960" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.483777] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a133a4af-0e8c-4929-b07b-b8c575afc960',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.558240] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.987098] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.987528] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.987528] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.987794] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.987977] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.988169] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Segment Port a133a4af-0e8c-4929-b07b-b8c575afc960 not found, creating... [ 1057.988532] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.988758] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.988903] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.989224] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.989417] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.989762] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.989986] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.990153] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.990460] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.990643] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.990802] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Resource: SegmentPort with ID: a133a4af-0e8c-4929-b07b-b8c575afc960 is going to be created. [ 1058.015490] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.015773] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.015914] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.016221] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.016483] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.016731] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "port-a133a4af-0e8c-4929-b07b-b8c575afc960" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.060859] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.329342] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe in Status: SUCCESS [ 1058.329626] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.329729] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.329953] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.330180] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.330290] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.330369] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.330522] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.330644] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.330707] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.330812] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('34e45751-3d11-4d8a-ad9f-272d1ad803fe',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.332106] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.332288] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.332415] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.332531] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.332595] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.332722] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.332797] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.332884] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34e45751-3d11-4d8a-ad9f-272d1ad803fe',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.563637] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.563885] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.563969] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.564203] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.564305] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.564415] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 is going to be updated. [ 1058.594029] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.594227] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.594227] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.594483] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.594881] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.605838] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 in Status: IN_PROGRESS for 2s [ 1058.708779] env[65471]: INFO networking_nsxv3.common.synchronization [req-7ea1bb78-3abb-41d6-a9d9-828fa0e3f027 req-1a328fb7-b733-43a1-a11c-5273da256dc7 service nova] Enqueued Resource ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 with Priority: HIGHEST for action security_group_rules [ 1058.708974] env[65471]: INFO networking_nsxv3.common.synchronization [req-7ea1bb78-3abb-41d6-a9d9-828fa0e3f027 req-1a328fb7-b733-43a1-a11c-5273da256dc7 service nova] Enqueued Resource ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 with Priority: HIGHEST for action security_group_members [ 1058.708974] env[65471]: INFO networking_nsxv3.common.synchronization [req-7ea1bb78-3abb-41d6-a9d9-828fa0e3f027 req-1a328fb7-b733-43a1-a11c-5273da256dc7 service nova] Enqueued Resource ID: a133a4af-0e8c-4929-b07b-b8c575afc960 with Priority: HIGHEST for action port [ 1058.709469] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 with Priority: HIGHEST for action security_group_rules [ 1058.709600] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 with Priority: HIGHEST for action security_group_members [ 1058.709694] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a133a4af-0e8c-4929-b07b-b8c575afc960 with Priority: HIGHEST for action port [ 1058.709964] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-735019a1-4315-46a6-b3c7-ec71fdc6ef33 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.710122] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.710187] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.710409] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.710495] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.711371] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-735019a1-4315-46a6-b3c7-ec71fdc6ef33 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.711468] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.711768] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-a133a4af-0e8c-4929-b07b-b8c575afc960 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.711925] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a133a4af-0e8c-4929-b07b-b8c575afc960" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.711925] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a133a4af-0e8c-4929-b07b-b8c575afc960" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.712080] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a133a4af-0e8c-4929-b07b-b8c575afc960" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.712152] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a133a4af-0e8c-4929-b07b-b8c575afc960',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.835025] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-34e45751-3d11-4d8a-ad9f-272d1ad803fe taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.835164] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.835329] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('34e45751-3d11-4d8a-ad9f-272d1ad803fe',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.213789] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-735019a1-4315-46a6-b3c7-ec71fdc6ef33 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.214129] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.214129] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a133a4af-0e8c-4929-b07b-b8c575afc960 with status ACTIVE [ 1059.214333] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.214474] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.214540] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.214761] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.214849] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.215034] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.215129] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.215192] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.215344] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.215415] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.215590] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.215680] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.215741] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.215875] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.215947] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.216042] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a133a4af-0e8c-4929-b07b-b8c575afc960 is going to be updated. [ 1059.239343] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.239508] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.239560] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.239762] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.239940] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.240117] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a133a4af-0e8c-4929-b07b-b8c575afc960" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.338734] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('34e45751-3d11-4d8a-ad9f-272d1ad803fe',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.629205] env[65471]: INFO networking_nsxv3.common.synchronization [req-e4fc8c77-aff3-42b2-9ec1-d2a022c04484 req-b8467e6d-d0e3-4eea-960e-d68951d29b47 tempest-DeleteServersTestJSON-72429361 tempest-DeleteServersTestJSON-72429361-project-member] Enqueued Resource ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 with Priority: HIGHEST for action security_group_members [ 1059.629887] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 with Priority: HIGHEST for action security_group_members [ 1059.630251] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-c35d5123-3fe1-447f-aedc-8112e5faa2b6 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.630395] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.630469] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.630682] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.630860] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.630985] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.631075] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.631221] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.631313] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.631691] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c35d5123-3fe1-447f-aedc-8112e5faa2b6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.842434] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.842614] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.842692] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.842941] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.843044] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.843149] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe is going to be updated. [ 1059.878531] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.878531] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.878531] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.878531] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.878531] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.888879] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe in Status: IN_PROGRESS for 2s [ 1060.134484] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.134816] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.134816] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.134974] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.161567] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.161851] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.161992] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.162101] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.162394] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.162394] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.162535] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 is going to be updated. [ 1060.192146] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.193110] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.193110] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.193110] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.193110] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.203855] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 in Status: IN_PROGRESS for 2s [ 1060.409604] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock network-80 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.409914] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "network-80" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.410089] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "network-80" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.410442] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "network-80" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.410732] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.410893] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.411013] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.411399] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.411737] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.412015] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1060.412160] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1060.412274] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1060.412430] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1060.412723] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1060.412723] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1060.412811] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1060.438882] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1060.439144] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1060.439319] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1060.439529] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "network-80" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.439878] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock port-aad84d40-ba06-4606-b145-27c37b1048fa taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.440121] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "port-aad84d40-ba06-4606-b145-27c37b1048fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.440215] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "port-aad84d40-ba06-4606-b145-27c37b1048fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.440511] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "port-aad84d40-ba06-4606-b145-27c37b1048fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.440651] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aad84d40-ba06-4606-b145-27c37b1048fa',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.616937] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 in Status: SUCCESS [ 1060.617183] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.617365] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.617594] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.617782] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.617898] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.617962] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.618125] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.618207] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.618302] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.943714] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.943978] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.944098] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.944425] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.944543] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.944697] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Segment Port aad84d40-ba06-4606-b145-27c37b1048fa not found, creating... [ 1060.944954] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.945123] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.945239] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.945455] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.945588] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.945890] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.946055] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.946174] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.946374] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.946508] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.946645] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Resource: SegmentPort with ID: aad84d40-ba06-4606-b145-27c37b1048fa is going to be created. [ 1060.969618] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.969828] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.969951] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.970262] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.970504] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.970732] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "port-aad84d40-ba06-4606-b145-27c37b1048fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.121388] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.623820] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.706715] env[65471]: INFO networking_nsxv3.common.synchronization [req-e4fc8c77-aff3-42b2-9ec1-d2a022c04484 req-29a42448-88ed-4bba-888b-e4a07401890f service nova] Enqueued Resource ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 with Priority: HIGHEST for action security_group_rules [ 1061.707096] env[65471]: INFO networking_nsxv3.common.synchronization [req-e4fc8c77-aff3-42b2-9ec1-d2a022c04484 req-29a42448-88ed-4bba-888b-e4a07401890f service nova] Enqueued Resource ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 with Priority: HIGHEST for action security_group_members [ 1061.707310] env[65471]: INFO networking_nsxv3.common.synchronization [req-e4fc8c77-aff3-42b2-9ec1-d2a022c04484 req-29a42448-88ed-4bba-888b-e4a07401890f service nova] Enqueued Resource ID: aad84d40-ba06-4606-b145-27c37b1048fa with Priority: HIGHEST for action port [ 1061.707809] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 with Priority: HIGHEST for action security_group_rules [ 1061.707948] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 with Priority: HIGHEST for action security_group_members [ 1061.708132] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aad84d40-ba06-4606-b145-27c37b1048fa with Priority: HIGHEST for action port [ 1061.708333] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c35d5123-3fe1-447f-aedc-8112e5faa2b6 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.708454] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.708517] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.708831] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.711406] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c35d5123-3fe1-447f-aedc-8112e5faa2b6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.711406] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-c35d5123-3fe1-447f-aedc-8112e5faa2b6 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.711406] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.711406] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-aad84d40-ba06-4606-b145-27c37b1048fa taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.711406] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aad84d40-ba06-4606-b145-27c37b1048fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.711406] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aad84d40-ba06-4606-b145-27c37b1048fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.711406] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aad84d40-ba06-4606-b145-27c37b1048fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.711406] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aad84d40-ba06-4606-b145-27c37b1048fa',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.899922] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe in Status: SUCCESS [ 1061.900179] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.900367] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.900599] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.900794] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.900912] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.900978] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.901146] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.901232] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.901345] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34e45751-3d11-4d8a-ad9f-272d1ad803fe',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.129116] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.129116] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.129116] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.129116] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.129116] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.129116] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 is going to be updated. [ 1062.164638] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.164638] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.164638] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.164638] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.164638] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.174064] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 in Status: IN_PROGRESS for 2s [ 1062.204727] env[65471]: INFO networking_nsxv3.common.synchronization [None req-be3ce471-58a4-4335-950c-dd13f2300ed1 tempest-AttachInterfacesTestJSON-1197806586 tempest-AttachInterfacesTestJSON-1197806586-project-member] Enqueued Resource ID: 89cca73a-b121-4b09-8f43-f96b481d6295 with Priority: HIGHEST for action security_group_rules [ 1062.206204] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89cca73a-b121-4b09-8f43-f96b481d6295 with Priority: HIGHEST for action security_group_rules [ 1062.206553] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-89cca73a-b121-4b09-8f43-f96b481d6295 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.206675] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-89cca73a-b121-4b09-8f43-f96b481d6295" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.206755] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-89cca73a-b121-4b09-8f43-f96b481d6295" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.207014] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-89cca73a-b121-4b09-8f43-f96b481d6295" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.207167] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('89cca73a-b121-4b09-8f43-f96b481d6295',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.212236] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-c35d5123-3fe1-447f-aedc-8112e5faa2b6 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.212236] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.212435] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aad84d40-ba06-4606-b145-27c37b1048fa with status ACTIVE [ 1062.212607] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.212792] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.212792] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.212979] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.213101] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.213243] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.213373] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.213431] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.213590] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.213733] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.213856] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.213959] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.214030] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.214173] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.214237] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.214408] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aad84d40-ba06-4606-b145-27c37b1048fa is going to be updated. [ 1062.216446] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 in Status: IN_PROGRESS for 4s [ 1062.238555] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.238751] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.238794] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.238986] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.239142] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.239306] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aad84d40-ba06-4606-b145-27c37b1048fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.311108] env[65471]: INFO networking_nsxv3.common.synchronization [None req-ec835f7b-943c-44d2-b253-a1ad880aeacc tempest-AttachInterfacesTestJSON-1197806586 tempest-AttachInterfacesTestJSON-1197806586-project-member] Enqueued Resource ID: 89cca73a-b121-4b09-8f43-f96b481d6295 with Priority: HIGHEST for action security_group_rules [ 1062.311775] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89cca73a-b121-4b09-8f43-f96b481d6295 with Priority: HIGHEST for action security_group_rules [ 1062.312907] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-89cca73a-b121-4b09-8f43-f96b481d6295 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.313031] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-89cca73a-b121-4b09-8f43-f96b481d6295" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.404976] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('34e45751-3d11-4d8a-ad9f-272d1ad803fe',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.731090] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.731538] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.731538] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.731819] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.731819] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.731923] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 89cca73a-b121-4b09-8f43-f96b481d6295 already deleted. [ 1062.732089] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-89cca73a-b121-4b09-8f43-f96b481d6295" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.732291] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-89cca73a-b121-4b09-8f43-f96b481d6295" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.732537] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-89cca73a-b121-4b09-8f43-f96b481d6295" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.732660] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('89cca73a-b121-4b09-8f43-f96b481d6295',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.911026] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('34e45751-3d11-4d8a-ad9f-272d1ad803fe',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.254443] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.254443] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.254703] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.254871] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.255055] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.255207] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 89cca73a-b121-4b09-8f43-f96b481d6295 already deleted. [ 1063.255358] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-89cca73a-b121-4b09-8f43-f96b481d6295" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.413908] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.414220] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.414362] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.415020] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.415197] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.415368] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe is going to be updated. [ 1063.451206] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.451400] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.451464] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.451756] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.451981] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.465544] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe in Status: IN_PROGRESS for 2s [ 1064.186043] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 in Status: SUCCESS [ 1064.186922] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.186922] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.186922] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.187244] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.187784] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.187784] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.187784] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.187784] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.188081] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.188081] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.232744] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 in Status: SUCCESS [ 1064.233010] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 deletion is rescheduled due to dependency. [ 1064.233158] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.233395] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.233675] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.233878] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.234041] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.234123] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.234348] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.234442] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.234597] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c35d5123-3fe1-447f-aedc-8112e5faa2b6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.693819] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-735019a1-4315-46a6-b3c7-ec71fdc6ef33 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.693819] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.693819] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.693819] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.693819] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.693819] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.693819] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.693819] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.693819] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.693819] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.693819] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-735019a1-4315-46a6-b3c7-ec71fdc6ef33 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.693819] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.693819] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.693819] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.693819] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.693819] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.694807] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.694807] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.694807] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.694807] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.694807] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.737602] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c35d5123-3fe1-447f-aedc-8112e5faa2b6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.196904] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 735019a1-4315-46a6-b3c7-ec71fdc6ef33: rpc.has_security_group_logging(os_id): False [ 1065.217270] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.217502] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.217502] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.217747] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.217910] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.218091] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.218187] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.218248] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.218410] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.218489] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.218685] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.218777] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.218932] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.219044] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.219044] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.219233] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.219351] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.219409] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.219523] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.219599] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.219685] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 is going to be updated. [ 1065.239740] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c35d5123-3fe1-447f-aedc-8112e5faa2b6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.288235] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.288394] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.288437] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.288658] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.288802] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.316213] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 in Status: IN_PROGRESS for 2s [ 1065.476204] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe in Status: SUCCESS [ 1065.476423] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.476601] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.476822] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.477030] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.477159] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.477225] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.477381] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.477461] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.477547] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.477710] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-34e45751-3d11-4d8a-ad9f-272d1ad803fe taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.477805] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.477866] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.478008] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.478163] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.478299] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.478627] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.478741] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.478797] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.478881] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.478971] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('34e45751-3d11-4d8a-ad9f-272d1ad803fe',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.743572] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.743822] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.743901] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.744066] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.744260] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.744260] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 is going to be updated. [ 1065.775641] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.775762] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.775825] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.776172] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.776369] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.787476] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 in Status: IN_PROGRESS for 2s [ 1065.981025] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 34e45751-3d11-4d8a-ad9f-272d1ad803fe: rpc.has_security_group_logging(os_id): False [ 1066.000897] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.001114] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.001187] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.001420] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.001570] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.001725] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.001818] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.001875] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.002210] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.002210] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.002365] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.002365] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.002461] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.002637] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.002698] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.002884] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.002973] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.002973] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.003232] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.003232] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.003460] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe is going to be updated. [ 1066.066638] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.066816] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.066857] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.067070] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.067238] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.081155] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe in Status: IN_PROGRESS for 2s [ 1067.313479] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1067.313894] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=5 [ 1067.332529] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 in Status: SUCCESS [ 1067.332938] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.798651] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 in Status: SUCCESS [ 1067.798880] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.799075] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.799308] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.799510] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.799633] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.799699] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.799850] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.799933] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.800051] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.800157] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c35d5123-3fe1-447f-aedc-8112e5faa2b6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.101233] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe in Status: SUCCESS [ 1068.101233] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.101233] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.101513] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.101513] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34e45751-3d11-4d8a-ad9f-272d1ad803fe',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.302787] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-c35d5123-3fe1-447f-aedc-8112e5faa2b6 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.302956] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.303023] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.303238] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.303454] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.303570] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.303631] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.303779] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.303856] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.304304] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.304304] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-c35d5123-3fe1-447f-aedc-8112e5faa2b6 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.304304] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.304304] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.304624] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.304771] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.304857] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.304910] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.306294] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.306294] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.306294] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.306294] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c35d5123-3fe1-447f-aedc-8112e5faa2b6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.382079] env[65471]: INFO networking_nsxv3.common.synchronization [req-ab0c70c6-0cfa-4a4b-ad0c-6982e39308b7 req-ea91769a-6415-49fb-8e2a-989c54c407c3 tempest-MultipleCreateTestJSON-1803706331 tempest-MultipleCreateTestJSON-1803706331-project-member] Enqueued Resource ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe with Priority: HIGHEST for action security_group_members [ 1068.382792] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe with Priority: HIGHEST for action security_group_members [ 1068.383128] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-34e45751-3d11-4d8a-ad9f-272d1ad803fe taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.383347] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.383347] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.384824] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.384824] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.385038] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.385150] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.385288] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.385377] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.385475] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34e45751-3d11-4d8a-ad9f-272d1ad803fe',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.473842] env[65471]: INFO networking_nsxv3.common.synchronization [req-5f26b49a-2653-4b16-be27-f38bc7e275f8 req-d85509e7-7c10-4b96-a137-b2be6e97c946 tempest-MultipleCreateTestJSON-1803706331 tempest-MultipleCreateTestJSON-1803706331-project-member] Enqueued Resource ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe with Priority: HIGHEST for action security_group_members [ 1068.478417] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe with Priority: HIGHEST for action security_group_members [ 1068.480669] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-34e45751-3d11-4d8a-ad9f-272d1ad803fe taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.480669] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.603960] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-34e45751-3d11-4d8a-ad9f-272d1ad803fe taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.604130] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.807767] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c35d5123-3fe1-447f-aedc-8112e5faa2b6: rpc.has_security_group_logging(os_id): False [ 1068.827769] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.827769] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.827769] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.828334] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.828334] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.828334] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.828522] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.828522] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.828665] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.828703] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.829459] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.829459] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.829459] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.829459] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.829734] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.829772] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.829892] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.829998] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.830880] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.830880] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.830880] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 is going to be updated. [ 1068.889434] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('34e45751-3d11-4d8a-ad9f-272d1ad803fe',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.911598] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.911758] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.911878] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.912266] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.912266] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.927749] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 in Status: IN_PROGRESS for 2s [ 1069.390377] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('34e45751-3d11-4d8a-ad9f-272d1ad803fe',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.892965] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.894432] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.894636] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.894754] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.894851] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.894956] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe is going to be updated. [ 1069.927560] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.928014] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.928169] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.928445] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.928645] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.938040] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe in Status: IN_PROGRESS for 2s [ 1070.945037] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 in Status: SUCCESS [ 1070.945424] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.693263] env[65471]: INFO networking_nsxv3.common.synchronization [req-215c6e85-b674-4539-9a1f-24dc4f514a98 req-ba30dd18-42cc-4d70-90fb-2f5b46d7893c tempest-ServerRescueNegativeTestJSON-1570103274 tempest-ServerRescueNegativeTestJSON-1570103274-project-member] Enqueued Resource ID: 6d51d32d-beb9-4c26-b877-a2c1a68caa39 with Priority: HIGHEST for action security_group_members [ 1071.693885] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d51d32d-beb9-4c26-b877-a2c1a68caa39 with Priority: HIGHEST for action security_group_members [ 1071.694202] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d51d32d-beb9-4c26-b877-a2c1a68caa39 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.694346] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d51d32d-beb9-4c26-b877-a2c1a68caa39" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.694419] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d51d32d-beb9-4c26-b877-a2c1a68caa39" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.696412] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d51d32d-beb9-4c26-b877-a2c1a68caa39" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.696763] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.696886] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.696955] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.697173] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.697256] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.697366] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d51d32d-beb9-4c26-b877-a2c1a68caa39',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.739058] env[65471]: INFO networking_nsxv3.common.synchronization [req-8236e1ac-f2c3-4b57-8212-255a7d3bf571 req-178dfa8f-80b0-4a65-8d92-0e67a7a3c189 tempest-ServersTestJSON-569130442 tempest-ServersTestJSON-569130442-project-member] Enqueued Resource ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 with Priority: HIGHEST for action security_group_members [ 1071.740265] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 with Priority: HIGHEST for action security_group_members [ 1071.740265] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-735019a1-4315-46a6-b3c7-ec71fdc6ef33 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.740265] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.740546] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.740546] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.740669] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.740846] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.740846] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.741083] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.742320] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.742458] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.951282] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe in Status: SUCCESS [ 1071.951815] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.951880] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.952120] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.952406] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.952556] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.952629] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.952873] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.952969] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.953101] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34e45751-3d11-4d8a-ad9f-272d1ad803fe',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.114065] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock network-72 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.114065] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "network-72" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.114065] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "network-72" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.114463] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "network-72" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.114463] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.114582] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.114685] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.114914] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.115068] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.115278] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1072.115389] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1072.115499] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1072.115607] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1072.115733] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1072.115843] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1072.115973] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1072.136427] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1072.136684] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1072.136855] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1072.137276] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "network-72" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.137849] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock port-3a812b9f-ab6e-4dbf-a505-a3b187c74651 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.137849] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "port-3a812b9f-ab6e-4dbf-a505-a3b187c74651" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.137849] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "port-3a812b9f-ab6e-4dbf-a505-a3b187c74651" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.138227] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "port-3a812b9f-ab6e-4dbf-a505-a3b187c74651" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.138227] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a812b9f-ab6e-4dbf-a505-a3b187c74651',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.199556] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.199777] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.199839] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.200034] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.200146] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.200380] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.200486] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.200549] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.200705] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.200781] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.200868] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d51d32d-beb9-4c26-b877-a2c1a68caa39 already deleted. [ 1072.200945] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d51d32d-beb9-4c26-b877-a2c1a68caa39" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.245540] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.457104] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.457564] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.462016] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.462016] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.462016] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.462016] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.462016] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.462016] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.462016] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.462016] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.462016] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe is going to be updated. [ 1072.511670] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.511937] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.511937] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.512166] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.512319] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.536782] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe in Status: IN_PROGRESS for 2s [ 1072.643772] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.643944] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.644224] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.644573] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.644738] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.644899] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Segment Port 3a812b9f-ab6e-4dbf-a505-a3b187c74651 not found, creating... [ 1072.645317] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.645394] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.645475] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.645688] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.645824] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.646127] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.646283] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.646412] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.646647] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.646803] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.646917] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Resource: SegmentPort with ID: 3a812b9f-ab6e-4dbf-a505-a3b187c74651 is going to be created. [ 1072.669914] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.670191] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.670889] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.670889] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.671105] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.671448] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "port-3a812b9f-ab6e-4dbf-a505-a3b187c74651" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.748364] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.251186] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.251561] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.251561] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.251641] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.251727] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.251993] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 is going to be updated. [ 1073.285538] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.285837] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.285923] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.286147] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.286291] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.305436] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 in Status: IN_PROGRESS for 2s [ 1073.440169] env[65471]: INFO networking_nsxv3.common.synchronization [req-215c6e85-b674-4539-9a1f-24dc4f514a98 req-aff9a0b3-288e-49db-8d95-b10e775c9d58 service nova] Enqueued Resource ID: 6d51d32d-beb9-4c26-b877-a2c1a68caa39 with Priority: HIGHEST for action security_group_rules [ 1073.440721] env[65471]: INFO networking_nsxv3.common.synchronization [req-215c6e85-b674-4539-9a1f-24dc4f514a98 req-aff9a0b3-288e-49db-8d95-b10e775c9d58 service nova] Enqueued Resource ID: 6d51d32d-beb9-4c26-b877-a2c1a68caa39 with Priority: HIGHEST for action security_group_members [ 1073.440890] env[65471]: INFO networking_nsxv3.common.synchronization [req-215c6e85-b674-4539-9a1f-24dc4f514a98 req-aff9a0b3-288e-49db-8d95-b10e775c9d58 service nova] Enqueued Resource ID: 3a812b9f-ab6e-4dbf-a505-a3b187c74651 with Priority: HIGHEST for action port [ 1073.441476] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d51d32d-beb9-4c26-b877-a2c1a68caa39 with Priority: HIGHEST for action security_group_rules [ 1073.441620] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d51d32d-beb9-4c26-b877-a2c1a68caa39 with Priority: HIGHEST for action security_group_members [ 1073.441719] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a812b9f-ab6e-4dbf-a505-a3b187c74651 with Priority: HIGHEST for action port [ 1073.441999] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d51d32d-beb9-4c26-b877-a2c1a68caa39 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.442172] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d51d32d-beb9-4c26-b877-a2c1a68caa39" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.442245] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d51d32d-beb9-4c26-b877-a2c1a68caa39" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.442436] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d51d32d-beb9-4c26-b877-a2c1a68caa39" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.442522] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d51d32d-beb9-4c26-b877-a2c1a68caa39',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.443398] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d51d32d-beb9-4c26-b877-a2c1a68caa39 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.443540] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d51d32d-beb9-4c26-b877-a2c1a68caa39" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.443607] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d51d32d-beb9-4c26-b877-a2c1a68caa39" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.443769] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d51d32d-beb9-4c26-b877-a2c1a68caa39" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.443924] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.444019] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.444075] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.444213] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.444295] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.444399] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d51d32d-beb9-4c26-b877-a2c1a68caa39',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.445150] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a812b9f-ab6e-4dbf-a505-a3b187c74651 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.445270] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a812b9f-ab6e-4dbf-a505-a3b187c74651" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.445362] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a812b9f-ab6e-4dbf-a505-a3b187c74651" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.445461] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a812b9f-ab6e-4dbf-a505-a3b187c74651" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.445739] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a812b9f-ab6e-4dbf-a505-a3b187c74651',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.947309] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d51d32d-beb9-4c26-b877-a2c1a68caa39 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.947532] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d51d32d-beb9-4c26-b877-a2c1a68caa39" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.947682] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d51d32d-beb9-4c26-b877-a2c1a68caa39',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.948874] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3a812b9f-ab6e-4dbf-a505-a3b187c74651 with status ACTIVE [ 1073.949094] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.949216] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.949304] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.949603] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.949603] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.949725] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.949832] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.949870] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.950095] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.950095] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.950274] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.950414] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.950469] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.950646] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.950733] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.950801] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3a812b9f-ab6e-4dbf-a505-a3b187c74651 is going to be updated. [ 1073.982358] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.982358] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.982358] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.982358] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.982358] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.982358] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a812b9f-ab6e-4dbf-a505-a3b187c74651" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.453904] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d51d32d-beb9-4c26-b877-a2c1a68caa39',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.550312] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe in Status: SUCCESS [ 1074.550312] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe deletion is rescheduled due to dependency. [ 1074.550312] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.550312] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.550312] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.550312] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.550312] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.550312] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.550890] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.550890] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.550890] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.550890] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('34e45751-3d11-4d8a-ad9f-272d1ad803fe',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.957115] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.957280] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.957353] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.957574] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.957670] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.957774] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d51d32d-beb9-4c26-b877-a2c1a68caa39 is going to be created. [ 1074.984948] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.985135] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.985209] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.985551] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.985727] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.005564] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d51d32d-beb9-4c26-b877-a2c1a68caa39 in Status: UNINITIALIZED for 2s [ 1075.053689] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-34e45751-3d11-4d8a-ad9f-272d1ad803fe taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.053894] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.053976] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.054256] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.054446] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.054556] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.054632] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.054834] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.054942] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.055103] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.055278] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-34e45751-3d11-4d8a-ad9f-272d1ad803fe taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.055383] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.055475] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.055639] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.055785] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.055874] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.055969] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.056163] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.056269] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.056827] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.057162] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('34e45751-3d11-4d8a-ad9f-272d1ad803fe',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.334363] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 in Status: SUCCESS [ 1075.335247] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.560533] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 34e45751-3d11-4d8a-ad9f-272d1ad803fe: rpc.has_security_group_logging(os_id): False [ 1075.585449] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.585700] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.585838] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.586180] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.586299] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.586573] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.586713] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.586808] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.586964] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.587064] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.587259] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.587371] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.587471] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.587559] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.587627] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.587810] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.587912] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.587975] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.588137] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.588215] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.588297] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe is going to be updated. [ 1075.689128] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.689324] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.689375] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.689666] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.689982] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.710215] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe in Status: IN_PROGRESS for 2s [ 1077.016505] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d51d32d-beb9-4c26-b877-a2c1a68caa39 in Status: SUCCESS [ 1077.016874] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d51d32d-beb9-4c26-b877-a2c1a68caa39" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.016916] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d51d32d-beb9-4c26-b877-a2c1a68caa39" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.017188] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d51d32d-beb9-4c26-b877-a2c1a68caa39" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.017406] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.017536] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.017606] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.017789] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.017883] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.017975] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d51d32d-beb9-4c26-b877-a2c1a68caa39" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.018080] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6d51d32d-beb9-4c26-b877-a2c1a68caa39',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.466464] env[65471]: INFO networking_nsxv3.common.synchronization [req-b8e12a1e-94be-4fd7-a64d-324512d29c32 req-e00e6575-a90d-4d03-8a11-d961fa2ff02a tempest-ServerDiskConfigTestJSON-1443816332 tempest-ServerDiskConfigTestJSON-1443816332-project-member] Enqueued Resource ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e with Priority: HIGHEST for action security_group_members [ 1077.467242] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e with Priority: HIGHEST for action security_group_members [ 1077.468044] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.468044] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.468044] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.468044] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.468311] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.468311] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.468311] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.468506] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.468613] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.468659] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c8a6eda-c0ec-4e25-8652-6acf3d57da4e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.521502] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6d51d32d-beb9-4c26-b877-a2c1a68caa39',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.748209] env[65471]: INFO networking_nsxv3.common.synchronization [req-3bce58fb-aeee-4411-892f-cf1a734c09ea req-4b3313fa-f9e0-4e37-be4a-d647b9e07dec tempest-AttachInterfacesTestJSON-1197806586 tempest-AttachInterfacesTestJSON-1197806586-project-member] Enqueued Resource ID: 89cca73a-b121-4b09-8f43-f96b481d6295 with Priority: HIGHEST for action security_group_members [ 1077.749287] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe in Status: SUCCESS [ 1077.749763] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.751118] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89cca73a-b121-4b09-8f43-f96b481d6295 with Priority: HIGHEST for action security_group_members [ 1077.753022] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-89cca73a-b121-4b09-8f43-f96b481d6295 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.753022] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89cca73a-b121-4b09-8f43-f96b481d6295" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.753022] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89cca73a-b121-4b09-8f43-f96b481d6295" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.753022] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89cca73a-b121-4b09-8f43-f96b481d6295" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.753022] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.753022] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.753674] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.754083] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.754336] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.754614] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('89cca73a-b121-4b09-8f43-f96b481d6295',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.973374] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.974516] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.975506] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.975506] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.999171] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.999545] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.999717] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.999831] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.000138] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.000262] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.000389] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e is going to be updated. [ 1078.023209] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6d51d32d-beb9-4c26-b877-a2c1a68caa39: rpc.has_security_group_logging(os_id): False [ 1078.041272] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.041577] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.041693] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.041897] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.042090] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.044152] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.044324] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.044324] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.044533] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.044621] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.044933] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.045044] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.045113] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.045275] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.045351] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.045437] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d51d32d-beb9-4c26-b877-a2c1a68caa39 is going to be created. [ 1078.060334] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e in Status: IN_PROGRESS for 2s [ 1078.120094] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.120094] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.120094] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.120094] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.120094] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.135011] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d51d32d-beb9-4c26-b877-a2c1a68caa39 in Status: IN_PROGRESS for 2s [ 1078.182582] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock network-238 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.182933] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "network-238" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.183144] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "network-238" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.183442] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "network-238" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.183811] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.183976] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.184124] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.184367] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.184721] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.185163] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1078.185284] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1078.185395] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1078.185509] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1078.185621] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1078.185725] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1078.185890] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1078.213023] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1078.213023] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1078.213023] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1078.213023] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "network-238" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.213023] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock port-4712d66b-7822-49e4-a840-f0ebb8444fff taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.213023] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "port-4712d66b-7822-49e4-a840-f0ebb8444fff" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.213023] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "port-4712d66b-7822-49e4-a840-f0ebb8444fff" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.213023] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "port-4712d66b-7822-49e4-a840-f0ebb8444fff" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.213023] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4712d66b-7822-49e4-a840-f0ebb8444fff',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.258571] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.258798] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.258909] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.259226] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.259362] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.259697] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.259914] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.259996] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.260314] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.260434] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.260566] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 89cca73a-b121-4b09-8f43-f96b481d6295 already deleted. [ 1078.260682] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89cca73a-b121-4b09-8f43-f96b481d6295" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.715314] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.715590] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.715754] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.716119] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.716257] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.716436] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Segment Port 4712d66b-7822-49e4-a840-f0ebb8444fff not found, creating... [ 1078.716709] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.716910] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.717026] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.717222] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.717399] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.717729] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.717891] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.718009] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.718320] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.718460] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.718618] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Resource: SegmentPort with ID: 4712d66b-7822-49e4-a840-f0ebb8444fff is going to be created. [ 1078.746391] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.746616] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.746726] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.746991] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.747234] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.747460] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "port-4712d66b-7822-49e4-a840-f0ebb8444fff" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.491118] env[65471]: INFO networking_nsxv3.common.synchronization [req-3bce58fb-aeee-4411-892f-cf1a734c09ea req-d857f35c-7b63-42c8-b79c-6ad142ef28a1 service nova] Enqueued Resource ID: 89cca73a-b121-4b09-8f43-f96b481d6295 with Priority: HIGHEST for action security_group_rules [ 1079.491386] env[65471]: INFO networking_nsxv3.common.synchronization [req-3bce58fb-aeee-4411-892f-cf1a734c09ea req-d857f35c-7b63-42c8-b79c-6ad142ef28a1 service nova] Enqueued Resource ID: 89cca73a-b121-4b09-8f43-f96b481d6295 with Priority: HIGHEST for action security_group_members [ 1079.491447] env[65471]: INFO networking_nsxv3.common.synchronization [req-3bce58fb-aeee-4411-892f-cf1a734c09ea req-d857f35c-7b63-42c8-b79c-6ad142ef28a1 service nova] Enqueued Resource ID: 4712d66b-7822-49e4-a840-f0ebb8444fff with Priority: HIGHEST for action port [ 1079.492010] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89cca73a-b121-4b09-8f43-f96b481d6295 with Priority: HIGHEST for action security_group_rules [ 1079.492152] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89cca73a-b121-4b09-8f43-f96b481d6295 with Priority: HIGHEST for action security_group_members [ 1079.492253] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4712d66b-7822-49e4-a840-f0ebb8444fff with Priority: HIGHEST for action port [ 1079.492546] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-89cca73a-b121-4b09-8f43-f96b481d6295 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.492716] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-89cca73a-b121-4b09-8f43-f96b481d6295" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.492766] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-89cca73a-b121-4b09-8f43-f96b481d6295" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.493289] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-89cca73a-b121-4b09-8f43-f96b481d6295" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.493382] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('89cca73a-b121-4b09-8f43-f96b481d6295',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.494490] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-89cca73a-b121-4b09-8f43-f96b481d6295 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.494697] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89cca73a-b121-4b09-8f43-f96b481d6295" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.494738] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89cca73a-b121-4b09-8f43-f96b481d6295" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.495830] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89cca73a-b121-4b09-8f43-f96b481d6295" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.495830] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.495830] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.495830] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.495830] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.495830] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.495830] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('89cca73a-b121-4b09-8f43-f96b481d6295',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.496766] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-4712d66b-7822-49e4-a840-f0ebb8444fff taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.496766] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4712d66b-7822-49e4-a840-f0ebb8444fff" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.496766] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4712d66b-7822-49e4-a840-f0ebb8444fff" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.496973] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4712d66b-7822-49e4-a840-f0ebb8444fff" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.497098] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4712d66b-7822-49e4-a840-f0ebb8444fff',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.998944] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('89cca73a-b121-4b09-8f43-f96b481d6295',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.000648] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-89cca73a-b121-4b09-8f43-f96b481d6295 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.000882] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89cca73a-b121-4b09-8f43-f96b481d6295" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.000981] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4712d66b-7822-49e4-a840-f0ebb8444fff with status ACTIVE [ 1080.001181] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.001291] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.001367] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.002034] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.002034] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.002034] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.002034] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.002305] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.002305] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.002305] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.002601] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.002679] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.002679] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.002809] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.002905] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.002951] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4712d66b-7822-49e4-a840-f0ebb8444fff is going to be updated. [ 1080.030802] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.031036] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.031036] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.031297] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.031483] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.031694] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4712d66b-7822-49e4-a840-f0ebb8444fff" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.089284] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e in Status: SUCCESS [ 1080.089627] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e deletion is rescheduled due to dependency. [ 1080.089806] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.155506] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d51d32d-beb9-4c26-b877-a2c1a68caa39 in Status: SUCCESS [ 1080.155803] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d51d32d-beb9-4c26-b877-a2c1a68caa39" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.505674] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('89cca73a-b121-4b09-8f43-f96b481d6295',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.008467] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.008669] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.008763] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.008952] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.009050] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.009175] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 89cca73a-b121-4b09-8f43-f96b481d6295 is going to be created. [ 1081.040373] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.040592] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.040659] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.040877] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.041059] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.056866] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89cca73a-b121-4b09-8f43-f96b481d6295 in Status: UNINITIALIZED for 2s [ 1083.072099] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89cca73a-b121-4b09-8f43-f96b481d6295 in Status: SUCCESS [ 1083.072894] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89cca73a-b121-4b09-8f43-f96b481d6295" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.072894] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89cca73a-b121-4b09-8f43-f96b481d6295" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.072894] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89cca73a-b121-4b09-8f43-f96b481d6295" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.072894] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.073418] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.073418] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.073418] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.073418] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.073418] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89cca73a-b121-4b09-8f43-f96b481d6295" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.073648] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('89cca73a-b121-4b09-8f43-f96b481d6295',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.576204] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('89cca73a-b121-4b09-8f43-f96b481d6295',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.079681] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 89cca73a-b121-4b09-8f43-f96b481d6295: rpc.has_security_group_logging(os_id): False [ 1084.103079] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.103274] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.103274] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.103695] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.103783] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.104915] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.104915] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.104915] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.104915] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.104915] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.104915] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 89cca73a-b121-4b09-8f43-f96b481d6295 is going to be created. [ 1084.173062] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.173313] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.173402] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.173681] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.173890] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.188856] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 89cca73a-b121-4b09-8f43-f96b481d6295 in Status: IN_PROGRESS for 2s [ 1084.494030] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1084.494030] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1086.204561] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 89cca73a-b121-4b09-8f43-f96b481d6295 in Status: SUCCESS [ 1086.204561] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-89cca73a-b121-4b09-8f43-f96b481d6295" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.374957] env[65471]: INFO networking_nsxv3.common.synchronization [req-60b775a9-449b-4242-bc18-ae77c8bfefdf req-d1c03ad9-0574-467d-b0f3-8a0717a4d75b tempest-ServerDiskConfigTestJSON-1443816332 tempest-ServerDiskConfigTestJSON-1443816332-project-member] Enqueued Resource ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e with Priority: HIGHEST for action security_group_members [ 1086.374957] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e with Priority: HIGHEST for action security_group_members [ 1086.374957] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.374957] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.374957] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.375276] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.375561] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.375629] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.375856] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.375856] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.375958] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.376070] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c8a6eda-c0ec-4e25-8652-6acf3d57da4e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.730229] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock network-537 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.730386] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "network-537" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.730511] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "network-537" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.730771] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "network-537" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.731262] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.731262] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.731391] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.731577] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.731724] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.731932] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1086.732084] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1086.732385] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1086.732385] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1086.732478] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1086.732529] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1086.732653] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1086.752719] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1086.752878] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1086.753029] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1086.755754] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "network-537" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.755754] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock port-5dcda83a-bdf2-404a-85bb-fa36b22bfd3a taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.755754] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "port-5dcda83a-bdf2-404a-85bb-fa36b22bfd3a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.755754] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "port-5dcda83a-bdf2-404a-85bb-fa36b22bfd3a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.755754] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "port-5dcda83a-bdf2-404a-85bb-fa36b22bfd3a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.755754] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5dcda83a-bdf2-404a-85bb-fa36b22bfd3a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.879146] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.879277] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.879358] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.879680] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.879767] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.879985] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.880144] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.880212] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.880399] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.880447] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.880539] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e is going to be updated. [ 1086.907347] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.907524] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.907565] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.907749] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.907891] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.917619] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e in Status: IN_PROGRESS for 2s [ 1087.257266] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.257663] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.257663] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.258066] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.258247] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.258479] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Segment Port 5dcda83a-bdf2-404a-85bb-fa36b22bfd3a not found, creating... [ 1087.258841] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.259029] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.259145] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.259377] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.259512] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.259842] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.260023] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.260224] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.260356] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.260548] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.260616] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Resource: SegmentPort with ID: 5dcda83a-bdf2-404a-85bb-fa36b22bfd3a is going to be created. [ 1087.282237] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.282545] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.282687] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.283049] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.283276] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.283511] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "port-5dcda83a-bdf2-404a-85bb-fa36b22bfd3a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.019679] env[65471]: INFO networking_nsxv3.common.synchronization [req-60b775a9-449b-4242-bc18-ae77c8bfefdf req-a6bf4463-d741-4348-b8c2-4d37e7f81c9c service nova] Enqueued Resource ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e with Priority: HIGHEST for action security_group_rules [ 1088.019950] env[65471]: INFO networking_nsxv3.common.synchronization [req-60b775a9-449b-4242-bc18-ae77c8bfefdf req-a6bf4463-d741-4348-b8c2-4d37e7f81c9c service nova] Enqueued Resource ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e with Priority: HIGHEST for action security_group_members [ 1088.020119] env[65471]: INFO networking_nsxv3.common.synchronization [req-60b775a9-449b-4242-bc18-ae77c8bfefdf req-a6bf4463-d741-4348-b8c2-4d37e7f81c9c service nova] Enqueued Resource ID: 5dcda83a-bdf2-404a-85bb-fa36b22bfd3a with Priority: HIGHEST for action port [ 1088.020611] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e with Priority: HIGHEST for action security_group_rules [ 1088.020750] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e with Priority: HIGHEST for action security_group_members [ 1088.020850] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dcda83a-bdf2-404a-85bb-fa36b22bfd3a with Priority: HIGHEST for action port [ 1088.024553] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.024694] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.024786] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.025055] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.025182] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1c8a6eda-c0ec-4e25-8652-6acf3d57da4e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.026190] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.026285] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.026474] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-5dcda83a-bdf2-404a-85bb-fa36b22bfd3a taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.026816] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5dcda83a-bdf2-404a-85bb-fa36b22bfd3a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.026816] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5dcda83a-bdf2-404a-85bb-fa36b22bfd3a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.026816] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5dcda83a-bdf2-404a-85bb-fa36b22bfd3a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.027110] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5dcda83a-bdf2-404a-85bb-fa36b22bfd3a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.529534] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.530695] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.530695] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5dcda83a-bdf2-404a-85bb-fa36b22bfd3a with status ACTIVE [ 1088.530695] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.530695] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.530695] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.530929] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.530929] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.531672] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.531672] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.531672] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.531672] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.531672] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.531672] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.531932] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.531932] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.532329] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.532329] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.532329] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5dcda83a-bdf2-404a-85bb-fa36b22bfd3a is going to be updated. [ 1088.555668] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.555907] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.556016] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.556340] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.556542] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.556822] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5dcda83a-bdf2-404a-85bb-fa36b22bfd3a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.773296] env[65471]: INFO networking_nsxv3.common.synchronization [req-55a21641-788c-4961-8694-3157205b2aad req-61f3f88c-55a4-4fd6-8eee-abfc8a8fad00 tempest-AttachVolumeNegativeTest-275281664 tempest-AttachVolumeNegativeTest-275281664-project-member] Enqueued Resource ID: 8c8d67e4-5b19-43b8-b618-1f0b1d72c71a with Priority: HIGHEST for action security_group_members [ 1088.773918] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c8d67e4-5b19-43b8-b618-1f0b1d72c71a with Priority: HIGHEST for action security_group_members [ 1088.774202] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c8d67e4-5b19-43b8-b618-1f0b1d72c71a taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.774338] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c8d67e4-5b19-43b8-b618-1f0b1d72c71a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.774450] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c8d67e4-5b19-43b8-b618-1f0b1d72c71a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.774617] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c8d67e4-5b19-43b8-b618-1f0b1d72c71a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.774778] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.774876] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.774947] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.775119] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.775201] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.775334] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c8d67e4-5b19-43b8-b618-1f0b1d72c71a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.928575] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e in Status: SUCCESS [ 1088.928756] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e deletion is rescheduled due to dependency. [ 1088.928873] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.929444] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.929703] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.929892] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.930013] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.930081] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.930405] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.930405] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.930405] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c8a6eda-c0ec-4e25-8652-6acf3d57da4e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.278595] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.278661] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.278795] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.279080] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.279237] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.279525] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.279744] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.279823] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.280012] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.280162] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.280295] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c8d67e4-5b19-43b8-b618-1f0b1d72c71a is going to be updated. [ 1089.311517] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.311772] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.311906] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.312257] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.312474] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.321776] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c8d67e4-5b19-43b8-b618-1f0b1d72c71a in Status: IN_PROGRESS for 2s [ 1089.433133] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1c8a6eda-c0ec-4e25-8652-6acf3d57da4e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.935888] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1c8a6eda-c0ec-4e25-8652-6acf3d57da4e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.437982] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.438251] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.441144] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.441144] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.441144] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.441144] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e is going to be updated. [ 1090.476757] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.476757] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.476757] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.476757] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.476972] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.486795] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e in Status: IN_PROGRESS for 2s [ 1091.337033] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c8d67e4-5b19-43b8-b618-1f0b1d72c71a in Status: SUCCESS [ 1091.337312] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c8d67e4-5b19-43b8-b618-1f0b1d72c71a deletion is rescheduled due to dependency. [ 1091.337371] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c8d67e4-5b19-43b8-b618-1f0b1d72c71a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.262907] env[65471]: INFO networking_nsxv3.common.synchronization [req-e57fcafc-1dc7-4dc7-a7f7-a0102d308bc3 req-85ccf7c3-3209-4741-9bcd-99d98acc7c42 tempest-ServersTestJSON-569130442 tempest-ServersTestJSON-569130442-project-member] Enqueued Resource ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 with Priority: HIGHEST for action security_group_members [ 1092.263974] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 with Priority: HIGHEST for action security_group_members [ 1092.263974] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-735019a1-4315-46a6-b3c7-ec71fdc6ef33 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.263974] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.263974] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.265121] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.265353] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.265457] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.265549] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.265728] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.265836] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.265938] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.501764] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e in Status: SUCCESS [ 1092.502099] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.502099] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.502827] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.506257] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.506407] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.506479] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.506697] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.506799] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.506930] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.507635] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1c8a6eda-c0ec-4e25-8652-6acf3d57da4e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.690377] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock network-92 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.690571] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "network-92" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.690696] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "network-92" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.690975] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "network-92" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.691249] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.691404] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.691517] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.691757] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.691907] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.692142] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1092.692256] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1092.692365] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1092.692472] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1092.692581] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1092.692687] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1092.692818] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1092.715331] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1092.715556] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1092.715699] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1092.715916] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "network-92" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.716230] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock port-3324eaca-3640-4c96-bbdb-c0ba32e47a61 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.716410] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "port-3324eaca-3640-4c96-bbdb-c0ba32e47a61" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.716530] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "port-3324eaca-3640-4c96-bbdb-c0ba32e47a61" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.716904] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "port-3324eaca-3640-4c96-bbdb-c0ba32e47a61" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.717282] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3324eaca-3640-4c96-bbdb-c0ba32e47a61',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.770393] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.009085] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.009280] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.009332] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.009552] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.009730] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.009827] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.009913] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.010061] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.010180] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.010244] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.010371] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.010471] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.010587] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.010643] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.010781] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.010863] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.010924] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.011059] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.011138] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.011218] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.011307] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1c8a6eda-c0ec-4e25-8652-6acf3d57da4e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.221018] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.221018] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.221018] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.221227] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.221430] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.221712] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Segment Port 3324eaca-3640-4c96-bbdb-c0ba32e47a61 not found, creating... [ 1093.222040] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.222322] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.222322] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.222632] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.222802] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.223123] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.223327] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.223455] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.223665] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.223819] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.223964] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Resource: SegmentPort with ID: 3324eaca-3640-4c96-bbdb-c0ba32e47a61 is going to be created. [ 1093.245377] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.245661] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.245881] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.246273] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.246636] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.246933] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "port-3324eaca-3640-4c96-bbdb-c0ba32e47a61" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.272975] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.514151] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e: rpc.has_security_group_logging(os_id): False [ 1093.537415] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.537598] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.538175] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.538443] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.538548] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.538769] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.538874] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.538936] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.539107] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.539185] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.539373] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.539490] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.539541] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.539695] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.539783] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.539965] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.540089] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.540145] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.540270] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.540381] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.540442] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e is going to be updated. [ 1093.609669] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.609931] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.610114] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.610453] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.610698] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.633520] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e in Status: IN_PROGRESS for 2s [ 1093.778617] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.778820] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.778884] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.779172] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.779265] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.779377] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 is going to be updated. [ 1093.814449] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.814629] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.814682] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.814976] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.815529] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.826653] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 in Status: IN_PROGRESS for 2s [ 1094.021963] env[65471]: INFO networking_nsxv3.common.synchronization [req-e57fcafc-1dc7-4dc7-a7f7-a0102d308bc3 req-e8cf5c6c-4458-4f05-9b97-38415a281108 service nova] Enqueued Resource ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 with Priority: HIGHEST for action security_group_rules [ 1094.022220] env[65471]: INFO networking_nsxv3.common.synchronization [req-e57fcafc-1dc7-4dc7-a7f7-a0102d308bc3 req-e8cf5c6c-4458-4f05-9b97-38415a281108 service nova] Enqueued Resource ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 with Priority: HIGHEST for action security_group_members [ 1094.022420] env[65471]: INFO networking_nsxv3.common.synchronization [req-e57fcafc-1dc7-4dc7-a7f7-a0102d308bc3 req-e8cf5c6c-4458-4f05-9b97-38415a281108 service nova] Enqueued Resource ID: 3324eaca-3640-4c96-bbdb-c0ba32e47a61 with Priority: HIGHEST for action port [ 1094.023011] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 with Priority: HIGHEST for action security_group_rules [ 1094.023200] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 with Priority: HIGHEST for action security_group_members [ 1094.023254] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3324eaca-3640-4c96-bbdb-c0ba32e47a61 with Priority: HIGHEST for action port [ 1094.023523] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-735019a1-4315-46a6-b3c7-ec71fdc6ef33 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.024189] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.024189] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.024189] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.024189] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.025158] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-735019a1-4315-46a6-b3c7-ec71fdc6ef33 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.025234] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.025451] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-3324eaca-3640-4c96-bbdb-c0ba32e47a61 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.025563] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3324eaca-3640-4c96-bbdb-c0ba32e47a61" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.025627] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3324eaca-3640-4c96-bbdb-c0ba32e47a61" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.025805] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3324eaca-3640-4c96-bbdb-c0ba32e47a61" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.025885] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3324eaca-3640-4c96-bbdb-c0ba32e47a61',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.528872] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-735019a1-4315-46a6-b3c7-ec71fdc6ef33 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.529177] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.532176] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3324eaca-3640-4c96-bbdb-c0ba32e47a61 with status ACTIVE [ 1094.534164] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.534164] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.534164] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.534164] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.534164] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.534164] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.534164] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.534164] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.534164] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.534164] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.534510] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.534656] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.535207] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.535443] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.535625] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.535729] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3324eaca-3640-4c96-bbdb-c0ba32e47a61 is going to be updated. [ 1094.563074] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.563227] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.563317] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.563506] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.563644] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.563891] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3324eaca-3640-4c96-bbdb-c0ba32e47a61" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.651549] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e in Status: SUCCESS [ 1095.651893] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.837321] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 in Status: SUCCESS [ 1095.837525] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.837814] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.838064] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.838286] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.838444] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.838534] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.838716] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.838825] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.838947] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.341063] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.843442] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.345676] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.345818] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.346329] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.346329] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.346329] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.346329] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 is going to be updated. [ 1097.385617] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.385818] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.385878] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.386098] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.386253] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.398393] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 in Status: IN_PROGRESS for 2s [ 1097.913029] env[65471]: INFO networking_nsxv3.common.synchronization [req-c071bf76-65c9-49d1-be8f-c08950f5afae req-4882df76-18ee-41bf-b18c-ab50f48f2849 tempest-ServerActionsTestJSON-1061383532 tempest-ServerActionsTestJSON-1061383532-project-member] Enqueued Resource ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 with Priority: HIGHEST for action security_group_members [ 1097.913639] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 with Priority: HIGHEST for action security_group_members [ 1097.914040] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-401f7079-c4c2-4951-b6ae-bc1cfbb23228 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.914180] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.914272] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.914619] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.914862] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.914995] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.915074] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.915748] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.915748] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.915748] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('401f7079-c4c2-4951-b6ae-bc1cfbb23228',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.417492] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.417655] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.417724] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.417957] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.418068] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.418281] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.418882] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.418882] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.418882] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.418882] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.418882] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 is going to be updated. [ 1098.448605] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.448811] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.448854] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.449050] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.449216] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.461292] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 in Status: IN_PROGRESS for 2s [ 1099.409099] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 in Status: SUCCESS [ 1099.409450] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.409501] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.409734] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.409962] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.410095] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.410162] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.410370] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.410474] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.410563] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.410653] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.912897] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-735019a1-4315-46a6-b3c7-ec71fdc6ef33 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.913078] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.913151] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.913371] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.913554] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.913656] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.913720] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.913888] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.913992] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.914095] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.914299] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-735019a1-4315-46a6-b3c7-ec71fdc6ef33 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.914359] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.914393] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.914503] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.914638] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.914726] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.914792] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.914950] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.915095] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.915129] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.915208] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.417577] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 735019a1-4315-46a6-b3c7-ec71fdc6ef33: rpc.has_security_group_logging(os_id): False [ 1100.437847] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.438068] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.438145] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.438412] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.438545] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.438807] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.438943] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.439028] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.439237] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.439376] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.439641] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.439772] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.439860] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.440040] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.440129] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.440399] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.440547] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.440629] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.440814] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.440931] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.441057] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 is going to be updated. [ 1100.469977] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 in Status: SUCCESS [ 1100.470220] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 deletion is rescheduled due to dependency. [ 1100.470277] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.509507] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.510309] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.510309] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.510309] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.510502] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.528942] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 in Status: IN_PROGRESS for 2s [ 1100.861468] env[65471]: INFO networking_nsxv3.common.synchronization [req-8c1f02ea-9cd3-4a5f-a4de-79afaaf8680a req-0a630632-134f-4360-9d8d-f531d22f8e6f tempest-ServerDiskConfigTestJSON-1443816332 tempest-ServerDiskConfigTestJSON-1443816332-project-member] Enqueued Resource ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e with Priority: HIGHEST for action security_group_members [ 1100.861561] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e with Priority: HIGHEST for action security_group_members [ 1100.861924] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.862078] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.862146] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.862340] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.862495] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.862591] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.862669] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.862815] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.862900] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.862993] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c8a6eda-c0ec-4e25-8652-6acf3d57da4e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.000382] env[65471]: INFO networking_nsxv3.common.synchronization [req-e7edda59-d410-4754-a503-5900303aab5a req-155ab77d-47c7-4e6b-b8c1-0fd5771bfcdf tempest-AttachInterfacesTestJSON-1197806586 tempest-AttachInterfacesTestJSON-1197806586-project-member] Enqueued Resource ID: 89cca73a-b121-4b09-8f43-f96b481d6295 with Priority: HIGHEST for action security_group_members [ 1101.001071] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89cca73a-b121-4b09-8f43-f96b481d6295 with Priority: HIGHEST for action security_group_members [ 1101.001475] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-89cca73a-b121-4b09-8f43-f96b481d6295 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.001645] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89cca73a-b121-4b09-8f43-f96b481d6295" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.001743] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89cca73a-b121-4b09-8f43-f96b481d6295" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.001967] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89cca73a-b121-4b09-8f43-f96b481d6295" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.002188] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.002322] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.002413] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.002590] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.002709] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.002833] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('89cca73a-b121-4b09-8f43-f96b481d6295',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.336023] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock network-238 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.336023] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "network-238" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.336023] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "network-238" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.336023] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "network-238" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.336023] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.336322] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.336452] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.336684] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.336864] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.337153] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1101.337272] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1101.337375] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1101.337476] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1101.337580] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1101.337678] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1101.337800] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1101.357467] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1101.358408] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1101.358408] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1101.358408] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "network-238" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.358408] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock port-b4806d65-f93d-491f-a7a6-a72c81809b5a taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.358408] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "port-b4806d65-f93d-491f-a7a6-a72c81809b5a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.358737] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "port-b4806d65-f93d-491f-a7a6-a72c81809b5a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.358843] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "port-b4806d65-f93d-491f-a7a6-a72c81809b5a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.358992] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4806d65-f93d-491f-a7a6-a72c81809b5a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.366853] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.367048] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.367170] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.367477] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.367639] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.367904] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.368047] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.368118] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.368317] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.368415] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.368537] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e is going to be updated. [ 1101.401433] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.401572] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.401646] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.401866] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.402093] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.413107] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e in Status: IN_PROGRESS for 2s [ 1101.504536] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('89cca73a-b121-4b09-8f43-f96b481d6295',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.862077] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.862321] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.862443] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.862735] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.863078] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.863256] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Segment Port b4806d65-f93d-491f-a7a6-a72c81809b5a not found, creating... [ 1101.863530] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.863693] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.863867] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.864135] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.864296] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.864668] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.864947] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.865148] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.865389] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.865538] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.865663] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Resource: SegmentPort with ID: b4806d65-f93d-491f-a7a6-a72c81809b5a is going to be created. [ 1101.886014] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.886299] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.886456] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.886773] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.887022] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.887260] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "port-b4806d65-f93d-491f-a7a6-a72c81809b5a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.006659] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('89cca73a-b121-4b09-8f43-f96b481d6295',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.509419] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.509766] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.509766] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.510475] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.510475] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.510475] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 89cca73a-b121-4b09-8f43-f96b481d6295 is going to be updated. [ 1102.551349] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.551534] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.551534] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.551762] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.551933] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.563299] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 in Status: SUCCESS [ 1102.563529] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.567659] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89cca73a-b121-4b09-8f43-f96b481d6295 in Status: IN_PROGRESS for 2s [ 1102.607197] env[65471]: INFO networking_nsxv3.common.synchronization [req-e7edda59-d410-4754-a503-5900303aab5a req-e9b21cf3-b8c5-4901-856f-6f633b55d449 service nova] Enqueued Resource ID: 89cca73a-b121-4b09-8f43-f96b481d6295 with Priority: HIGHEST for action security_group_rules [ 1102.607197] env[65471]: INFO networking_nsxv3.common.synchronization [req-e7edda59-d410-4754-a503-5900303aab5a req-e9b21cf3-b8c5-4901-856f-6f633b55d449 service nova] Enqueued Resource ID: 89cca73a-b121-4b09-8f43-f96b481d6295 with Priority: HIGHEST for action security_group_members [ 1102.607197] env[65471]: INFO networking_nsxv3.common.synchronization [req-e7edda59-d410-4754-a503-5900303aab5a req-e9b21cf3-b8c5-4901-856f-6f633b55d449 service nova] Enqueued Resource ID: b4806d65-f93d-491f-a7a6-a72c81809b5a with Priority: HIGHEST for action port [ 1102.607769] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89cca73a-b121-4b09-8f43-f96b481d6295 with Priority: HIGHEST for action security_group_rules [ 1102.607769] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89cca73a-b121-4b09-8f43-f96b481d6295 with Priority: HIGHEST for action security_group_members [ 1102.607769] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4806d65-f93d-491f-a7a6-a72c81809b5a with Priority: HIGHEST for action port [ 1102.607887] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-89cca73a-b121-4b09-8f43-f96b481d6295 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.610031] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-89cca73a-b121-4b09-8f43-f96b481d6295" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.610031] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-89cca73a-b121-4b09-8f43-f96b481d6295" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.610031] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-89cca73a-b121-4b09-8f43-f96b481d6295" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.610031] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('89cca73a-b121-4b09-8f43-f96b481d6295',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.610031] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-89cca73a-b121-4b09-8f43-f96b481d6295 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.610031] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89cca73a-b121-4b09-8f43-f96b481d6295" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.610031] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-b4806d65-f93d-491f-a7a6-a72c81809b5a taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.610031] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b4806d65-f93d-491f-a7a6-a72c81809b5a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.610031] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b4806d65-f93d-491f-a7a6-a72c81809b5a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.610031] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b4806d65-f93d-491f-a7a6-a72c81809b5a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.610031] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4806d65-f93d-491f-a7a6-a72c81809b5a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.111951] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-89cca73a-b121-4b09-8f43-f96b481d6295 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.112112] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89cca73a-b121-4b09-8f43-f96b481d6295" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.112258] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b4806d65-f93d-491f-a7a6-a72c81809b5a with status ACTIVE [ 1103.112453] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.112566] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.112632] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.112857] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.112949] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.113134] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.113228] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.113289] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.113442] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.113516] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.113695] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.113788] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.113858] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.114080] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.114167] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.114279] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b4806d65-f93d-491f-a7a6-a72c81809b5a is going to be updated. [ 1103.146364] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.146582] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.146665] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.146866] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.147191] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.147337] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b4806d65-f93d-491f-a7a6-a72c81809b5a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.424672] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e in Status: SUCCESS [ 1103.424866] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c8a6eda-c0ec-4e25-8652-6acf3d57da4e deletion is rescheduled due to dependency. [ 1103.424996] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c8a6eda-c0ec-4e25-8652-6acf3d57da4e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.448717] env[65471]: INFO networking_nsxv3.common.synchronization [req-7ec57789-286e-46b9-b201-74159f49c4e8 req-3dd42f4b-88d0-46f3-b663-1d85719e9b56 tempest-DeleteServersTestJSON-72429361 tempest-DeleteServersTestJSON-72429361-project-member] Enqueued Resource ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 with Priority: HIGHEST for action security_group_members [ 1103.448717] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 with Priority: HIGHEST for action security_group_members [ 1103.448838] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-c35d5123-3fe1-447f-aedc-8112e5faa2b6 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.448905] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.448973] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.449359] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.449609] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.449724] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.449800] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.449962] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.450054] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.450151] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c35d5123-3fe1-447f-aedc-8112e5faa2b6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.952176] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.953481] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.953481] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.953481] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.953481] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.953699] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.953901] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.953901] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.954106] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.954207] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.954346] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 is going to be updated. [ 1103.994279] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.994462] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.994576] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.994779] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.994976] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.007253] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 in Status: IN_PROGRESS for 2s [ 1104.587589] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89cca73a-b121-4b09-8f43-f96b481d6295 in Status: SUCCESS [ 1104.588090] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89cca73a-b121-4b09-8f43-f96b481d6295" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.588277] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89cca73a-b121-4b09-8f43-f96b481d6295" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.588508] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89cca73a-b121-4b09-8f43-f96b481d6295" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.588874] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.589021] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.589089] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.589434] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.589434] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.589434] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('89cca73a-b121-4b09-8f43-f96b481d6295',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.094902] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('89cca73a-b121-4b09-8f43-f96b481d6295',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.597428] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('89cca73a-b121-4b09-8f43-f96b481d6295',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.019769] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 in Status: SUCCESS [ 1106.019975] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 deletion is rescheduled due to dependency. [ 1106.020120] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.102155] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.102429] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.102429] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.103381] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.103381] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.103381] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 89cca73a-b121-4b09-8f43-f96b481d6295 is going to be updated. [ 1106.130709] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.131029] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.131029] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.131230] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.131375] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.140833] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89cca73a-b121-4b09-8f43-f96b481d6295 in Status: IN_PROGRESS for 2s [ 1106.304109] env[65471]: INFO networking_nsxv3.common.synchronization [req-e4c8f1fa-1925-4ff5-8c00-6368c5e20923 req-950b1545-71f1-4808-bbf7-73fba57f2533 tempest-AttachVolumeNegativeTest-275281664 tempest-AttachVolumeNegativeTest-275281664-project-member] Enqueued Resource ID: 8a168c13-528b-4758-b139-f0aa310cde5c with Priority: HIGHEST for action security_group_members [ 1106.304544] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a168c13-528b-4758-b139-f0aa310cde5c with Priority: HIGHEST for action security_group_members [ 1106.304869] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a168c13-528b-4758-b139-f0aa310cde5c taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.305012] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a168c13-528b-4758-b139-f0aa310cde5c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.305621] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a168c13-528b-4758-b139-f0aa310cde5c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.305883] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a168c13-528b-4758-b139-f0aa310cde5c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.306135] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.306285] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.306380] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.306598] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.307083] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.307083] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a168c13-528b-4758-b139-f0aa310cde5c',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.809773] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.809933] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.810015] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.810255] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.832373] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.832634] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.832754] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.832824] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.833038] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.833178] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.833507] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a168c13-528b-4758-b139-f0aa310cde5c is going to be updated. [ 1106.861356] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.861356] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.861522] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.861641] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.861803] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.871803] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a168c13-528b-4758-b139-f0aa310cde5c in Status: IN_PROGRESS for 2s [ 1108.152720] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89cca73a-b121-4b09-8f43-f96b481d6295 in Status: SUCCESS [ 1108.153130] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89cca73a-b121-4b09-8f43-f96b481d6295" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.153257] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89cca73a-b121-4b09-8f43-f96b481d6295" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.153451] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89cca73a-b121-4b09-8f43-f96b481d6295" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.153638] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.153755] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.153821] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.154038] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.154129] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.154202] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89cca73a-b121-4b09-8f43-f96b481d6295" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.154303] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('89cca73a-b121-4b09-8f43-f96b481d6295',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.659711] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('89cca73a-b121-4b09-8f43-f96b481d6295',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.882386] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a168c13-528b-4758-b139-f0aa310cde5c in Status: SUCCESS [ 1108.882722] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a168c13-528b-4758-b139-f0aa310cde5c deletion is rescheduled due to dependency. [ 1108.882722] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a168c13-528b-4758-b139-f0aa310cde5c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.162081] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 89cca73a-b121-4b09-8f43-f96b481d6295: rpc.has_security_group_logging(os_id): False [ 1109.179444] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.179444] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.179444] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.179681] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.179681] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.180054] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.180139] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.180139] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.180295] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.180363] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.180602] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 89cca73a-b121-4b09-8f43-f96b481d6295 is going to be updated. [ 1109.247497] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.247733] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.247780] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.248107] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.248705] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.261490] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 89cca73a-b121-4b09-8f43-f96b481d6295 in Status: IN_PROGRESS for 2s [ 1109.834629] env[65471]: INFO networking_nsxv3.common.synchronization [req-fc13ef4d-d148-495e-8650-48cbf7b8cfcd req-824d067d-abf3-4587-9763-446a330c71f3 tempest-ServerActionsTestJSON-1061383532 tempest-ServerActionsTestJSON-1061383532-project-member] Enqueued Resource ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 with Priority: HIGHEST for action security_group_members [ 1109.835299] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 with Priority: HIGHEST for action security_group_members [ 1109.835504] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-401f7079-c4c2-4951-b6ae-bc1cfbb23228 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.835650] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.835698] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.835886] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.836046] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.836147] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.836253] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.836355] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.836440] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.836534] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('401f7079-c4c2-4951-b6ae-bc1cfbb23228',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.135052] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock network-487 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.135192] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "network-487" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.135246] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "network-487" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.135498] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "network-487" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.136284] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.136418] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.136551] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.137458] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.137458] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.137458] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1110.137458] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1110.137458] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1110.137458] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1110.137629] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1110.137629] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1110.137743] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1110.157785] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1110.157965] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1110.158135] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1110.158310] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "network-487" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.158620] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock port-625cf8bd-ff1c-4cf8-94ba-8e0aae2adf3b taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.158793] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "port-625cf8bd-ff1c-4cf8-94ba-8e0aae2adf3b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.158926] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "port-625cf8bd-ff1c-4cf8-94ba-8e0aae2adf3b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.159276] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "port-625cf8bd-ff1c-4cf8-94ba-8e0aae2adf3b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.159425] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('625cf8bd-ff1c-4cf8-94ba-8e0aae2adf3b',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.338588] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.338987] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.338987] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.339220] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.339299] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.339540] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.339651] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.339743] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.339933] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.340056] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.340125] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 is going to be updated. [ 1110.372124] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.372336] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.372435] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.372717] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.372914] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.383632] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 in Status: IN_PROGRESS for 2s [ 1110.662460] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.662788] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.662901] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.667090] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.667090] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.667090] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Segment Port 625cf8bd-ff1c-4cf8-94ba-8e0aae2adf3b not found, creating... [ 1110.667090] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.667090] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.667090] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.667090] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.667090] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.667090] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.667090] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.668138] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.668138] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.668138] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.668138] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Resource: SegmentPort with ID: 625cf8bd-ff1c-4cf8-94ba-8e0aae2adf3b is going to be created. [ 1110.691540] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.691863] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.691863] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.692040] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.692284] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.692518] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "port-625cf8bd-ff1c-4cf8-94ba-8e0aae2adf3b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.275880] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 89cca73a-b121-4b09-8f43-f96b481d6295 in Status: SUCCESS [ 1111.276684] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-89cca73a-b121-4b09-8f43-f96b481d6295" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.409907] env[65471]: INFO networking_nsxv3.common.synchronization [req-fc13ef4d-d148-495e-8650-48cbf7b8cfcd req-7fe13e2b-a03a-46dd-a19f-511a23d0dc2b service nova] Enqueued Resource ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 with Priority: HIGHEST for action security_group_rules [ 1111.410164] env[65471]: INFO networking_nsxv3.common.synchronization [req-fc13ef4d-d148-495e-8650-48cbf7b8cfcd req-7fe13e2b-a03a-46dd-a19f-511a23d0dc2b service nova] Enqueued Resource ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 with Priority: HIGHEST for action security_group_members [ 1111.410268] env[65471]: INFO networking_nsxv3.common.synchronization [req-fc13ef4d-d148-495e-8650-48cbf7b8cfcd req-7fe13e2b-a03a-46dd-a19f-511a23d0dc2b service nova] Enqueued Resource ID: 625cf8bd-ff1c-4cf8-94ba-8e0aae2adf3b with Priority: HIGHEST for action port [ 1111.410854] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 with Priority: HIGHEST for action security_group_rules [ 1111.410993] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 with Priority: HIGHEST for action security_group_members [ 1111.412130] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 625cf8bd-ff1c-4cf8-94ba-8e0aae2adf3b with Priority: HIGHEST for action port [ 1111.412532] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-401f7079-c4c2-4951-b6ae-bc1cfbb23228 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.412682] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.412773] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.413007] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.413135] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('401f7079-c4c2-4951-b6ae-bc1cfbb23228',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.414255] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-401f7079-c4c2-4951-b6ae-bc1cfbb23228 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.414255] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.414397] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-625cf8bd-ff1c-4cf8-94ba-8e0aae2adf3b taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.414534] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-625cf8bd-ff1c-4cf8-94ba-8e0aae2adf3b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.414629] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-625cf8bd-ff1c-4cf8-94ba-8e0aae2adf3b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.414870] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-625cf8bd-ff1c-4cf8-94ba-8e0aae2adf3b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.414999] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('625cf8bd-ff1c-4cf8-94ba-8e0aae2adf3b',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.592474] env[65471]: INFO networking_nsxv3.common.synchronization [req-21e6ef21-aa7b-4946-9dba-c95d09cbbb1c req-52a3403f-5e86-40ed-91e2-c73b28093a27 tempest-ListImageFiltersTestJSON-417187835 tempest-ListImageFiltersTestJSON-417187835-project-member] Enqueued Resource ID: 2c8ff43e-9a83-418c-851d-179c01ee77a0 with Priority: HIGHEST for action security_group_members [ 1111.593133] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c8ff43e-9a83-418c-851d-179c01ee77a0 with Priority: HIGHEST for action security_group_members [ 1111.593662] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c8ff43e-9a83-418c-851d-179c01ee77a0 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.593763] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c8ff43e-9a83-418c-851d-179c01ee77a0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.593846] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c8ff43e-9a83-418c-851d-179c01ee77a0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.594130] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c8ff43e-9a83-418c-851d-179c01ee77a0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.594324] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.594435] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.594518] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.594710] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.594804] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.594901] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c8ff43e-9a83-418c-851d-179c01ee77a0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.917260] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-401f7079-c4c2-4951-b6ae-bc1cfbb23228 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.917260] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.920062] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 625cf8bd-ff1c-4cf8-94ba-8e0aae2adf3b with status ACTIVE [ 1111.920062] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.920062] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.920062] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.920325] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.920400] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.920587] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.920689] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.921032] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.921032] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.921032] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.921190] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.921340] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.921394] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.921541] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.921631] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.921703] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 625cf8bd-ff1c-4cf8-94ba-8e0aae2adf3b is going to be updated. [ 1111.946328] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.946539] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.946633] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.946854] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.947071] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.947201] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-625cf8bd-ff1c-4cf8-94ba-8e0aae2adf3b" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.097439] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2c8ff43e-9a83-418c-851d-179c01ee77a0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.248714] env[65471]: INFO networking_nsxv3.common.synchronization [req-cd2dc891-f931-4a76-858b-a45eadbbf7f0 req-30a6f13d-eca2-4e04-bb76-bbae90359861 tempest-ServersTestJSON-569130442 tempest-ServersTestJSON-569130442-project-member] Enqueued Resource ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 with Priority: HIGHEST for action security_group_members [ 1112.249327] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 with Priority: HIGHEST for action security_group_members [ 1112.249686] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-735019a1-4315-46a6-b3c7-ec71fdc6ef33 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.249817] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.249898] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.251494] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.251668] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.251775] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.251857] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.252060] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.252158] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.252257] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.399214] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 in Status: SUCCESS [ 1112.399214] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 deletion is rescheduled due to dependency. [ 1112.399214] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.399667] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.400086] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.402073] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.402073] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.402073] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.402313] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.402358] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.402495] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('401f7079-c4c2-4951-b6ae-bc1cfbb23228',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.600047] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2c8ff43e-9a83-418c-851d-179c01ee77a0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.695377] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock network-92 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.695567] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "network-92" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.695684] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "network-92" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.695965] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "network-92" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.696242] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.696419] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.696536] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.696746] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.696882] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.697139] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1112.697259] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1112.697365] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1112.697471] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1112.697575] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1112.697674] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1112.697801] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1112.718602] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1112.718828] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1112.718926] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1112.719084] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "network-92" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.719444] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock port-64ed9946-8be9-4715-b4ae-eec82d57d984 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.719614] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "port-64ed9946-8be9-4715-b4ae-eec82d57d984" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.721023] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "port-64ed9946-8be9-4715-b4ae-eec82d57d984" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.721023] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "port-64ed9946-8be9-4715-b4ae-eec82d57d984" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.721023] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64ed9946-8be9-4715-b4ae-eec82d57d984',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.754233] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.905427] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('401f7079-c4c2-4951-b6ae-bc1cfbb23228',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.102372] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.102543] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.102607] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.102844] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.102938] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.103054] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c8ff43e-9a83-418c-851d-179c01ee77a0 is going to be updated. [ 1113.193390] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.193390] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.193390] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.193390] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.193390] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.204520] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c8ff43e-9a83-418c-851d-179c01ee77a0 in Status: IN_PROGRESS for 2s [ 1113.223824] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.223824] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.223824] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.223824] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.223824] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.223824] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Segment Port 64ed9946-8be9-4715-b4ae-eec82d57d984 not found, creating... [ 1113.224376] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.225729] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.225729] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.225729] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.225729] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.226229] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.226579] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.226847] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.227276] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.227584] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.227892] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Resource: SegmentPort with ID: 64ed9946-8be9-4715-b4ae-eec82d57d984 is going to be created. [ 1113.252448] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.252665] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.252870] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.253183] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.253415] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.253651] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "port-64ed9946-8be9-4715-b4ae-eec82d57d984" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.256204] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.407831] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('401f7079-c4c2-4951-b6ae-bc1cfbb23228',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.508694] env[65471]: INFO networking_nsxv3.common.synchronization [None req-85ffb0b8-871e-4e87-a217-4526d562e9d2 tempest-AttachInterfacesTestJSON-1197806586 tempest-AttachInterfacesTestJSON-1197806586-project-member] Enqueued Resource ID: e8869e0a-9385-48b2-ac90-589c8415df21 with Priority: HIGHEST for action security_group_members [ 1113.508898] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8869e0a-9385-48b2-ac90-589c8415df21 with Priority: HIGHEST for action security_group_members [ 1113.509261] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8869e0a-9385-48b2-ac90-589c8415df21 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.509386] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.509517] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.509648] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.509800] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.509998] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.509998] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.510122] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.510231] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.510642] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e8869e0a-9385-48b2-ac90-589c8415df21',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.758471] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.758875] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.758875] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.758972] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.758972] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.762048] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 is going to be updated. [ 1113.787672] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.787672] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.787672] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.787908] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.788106] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.797744] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 in Status: IN_PROGRESS for 2s [ 1113.909821] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.910053] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.910165] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.910420] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.910519] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.910620] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 is going to be updated. [ 1113.922773] env[65471]: INFO networking_nsxv3.common.synchronization [req-dc6f2938-8558-4a6b-894f-69f2762ca924 req-7f856d11-5322-4fdc-b7eb-6f1d5f8f0d02 tempest-ServerActionsTestOtherA-1623203122 tempest-ServerActionsTestOtherA-1623203122-project-member] Enqueued Resource ID: 0c92cf42-7023-4aba-91c3-95f84d379c9f with Priority: HIGHEST for action security_group_members [ 1113.923374] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c92cf42-7023-4aba-91c3-95f84d379c9f with Priority: HIGHEST for action security_group_members [ 1113.923718] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c92cf42-7023-4aba-91c3-95f84d379c9f taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.923868] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c92cf42-7023-4aba-91c3-95f84d379c9f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.923941] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c92cf42-7023-4aba-91c3-95f84d379c9f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.924730] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c92cf42-7023-4aba-91c3-95f84d379c9f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.924730] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.924730] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.924730] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.924923] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.924923] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.924993] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c92cf42-7023-4aba-91c3-95f84d379c9f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.944222] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.944404] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.944467] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.944690] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.944836] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.953857] env[65471]: INFO networking_nsxv3.common.synchronization [req-cd2dc891-f931-4a76-858b-a45eadbbf7f0 req-310a1966-ec88-40c7-978f-bbfb8ff54732 service nova] Enqueued Resource ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 with Priority: HIGHEST for action security_group_rules [ 1113.954097] env[65471]: INFO networking_nsxv3.common.synchronization [req-cd2dc891-f931-4a76-858b-a45eadbbf7f0 req-310a1966-ec88-40c7-978f-bbfb8ff54732 service nova] Enqueued Resource ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 with Priority: HIGHEST for action security_group_members [ 1113.954253] env[65471]: INFO networking_nsxv3.common.synchronization [req-cd2dc891-f931-4a76-858b-a45eadbbf7f0 req-310a1966-ec88-40c7-978f-bbfb8ff54732 service nova] Enqueued Resource ID: 64ed9946-8be9-4715-b4ae-eec82d57d984 with Priority: HIGHEST for action port [ 1113.955105] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 with Priority: HIGHEST for action security_group_rules [ 1113.955251] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 with Priority: HIGHEST for action security_group_members [ 1113.955353] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64ed9946-8be9-4715-b4ae-eec82d57d984 with Priority: HIGHEST for action port [ 1113.955632] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-735019a1-4315-46a6-b3c7-ec71fdc6ef33 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.955776] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.955805] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.956095] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.956095] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.957493] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-735019a1-4315-46a6-b3c7-ec71fdc6ef33 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.957594] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.957804] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-64ed9946-8be9-4715-b4ae-eec82d57d984 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.957908] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-64ed9946-8be9-4715-b4ae-eec82d57d984" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.957974] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-64ed9946-8be9-4715-b4ae-eec82d57d984" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.958203] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-64ed9946-8be9-4715-b4ae-eec82d57d984" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.958285] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64ed9946-8be9-4715-b4ae-eec82d57d984',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.978529] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 in Status: IN_PROGRESS for 2s [ 1114.012354] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.012602] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.012693] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.012924] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.050738] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.051349] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.051349] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.051349] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.051483] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.051483] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.051815] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8869e0a-9385-48b2-ac90-589c8415df21 is going to be updated. [ 1114.100374] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.100564] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.100618] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.101233] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.101395] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.114094] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8869e0a-9385-48b2-ac90-589c8415df21 in Status: IN_PROGRESS for 2s [ 1114.426889] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.427954] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.428053] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.428291] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.454801] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.455067] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.455152] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.455223] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.455424] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.455507] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.455591] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c92cf42-7023-4aba-91c3-95f84d379c9f is going to be updated. [ 1114.458272] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-735019a1-4315-46a6-b3c7-ec71fdc6ef33 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.458410] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.463719] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 64ed9946-8be9-4715-b4ae-eec82d57d984 with status ACTIVE [ 1114.463943] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.464118] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.464187] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.464395] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.464482] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.464685] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.464788] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.464851] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.465028] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.465105] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.465283] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.465374] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.465433] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.465579] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.465651] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.465734] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 64ed9946-8be9-4715-b4ae-eec82d57d984 is going to be updated. [ 1114.488615] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.488752] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.488820] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.489054] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.489202] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.489371] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-64ed9946-8be9-4715-b4ae-eec82d57d984" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.494369] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.494486] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.494558] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.494760] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.494892] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.503386] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c92cf42-7023-4aba-91c3-95f84d379c9f in Status: IN_PROGRESS for 2s [ 1114.595327] env[65471]: INFO networking_nsxv3.common.synchronization [req-394f05f8-b142-4a6c-826d-deea953017d6 req-46a3215d-c157-4cca-a71b-9e4197f1b33c tempest-DeleteServersTestJSON-72429361 tempest-DeleteServersTestJSON-72429361-project-member] Enqueued Resource ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 with Priority: HIGHEST for action security_group_members [ 1114.595327] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 with Priority: HIGHEST for action security_group_members [ 1114.595327] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-c35d5123-3fe1-447f-aedc-8112e5faa2b6 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.595616] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.596385] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.596385] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.596537] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.596537] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.596646] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.596893] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.596983] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.597106] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c35d5123-3fe1-447f-aedc-8112e5faa2b6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.941917] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock network-80 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.941917] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "network-80" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.941917] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "network-80" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.942335] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "network-80" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.942335] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.942501] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.942622] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.942848] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.942992] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.943381] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1114.943549] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1114.943752] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1114.943912] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1114.944154] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1114.944376] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1114.945327] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1114.963579] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1114.964130] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1114.964352] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1114.964669] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "network-80" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.964983] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock port-14e5f0ad-93b4-429a-b62d-2004377d1584 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.965278] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "port-14e5f0ad-93b4-429a-b62d-2004377d1584" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.965474] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "port-14e5f0ad-93b4-429a-b62d-2004377d1584" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.965838] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "port-14e5f0ad-93b4-429a-b62d-2004377d1584" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.966069] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14e5f0ad-93b4-429a-b62d-2004377d1584',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.101622] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.101962] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.102179] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.102540] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.102732] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.103081] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.103444] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.103444] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.103693] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.103869] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.104061] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 is going to be updated. [ 1115.136426] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.137725] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.137725] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.137725] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.137725] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.151028] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 in Status: IN_PROGRESS for 2s [ 1115.216867] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c8ff43e-9a83-418c-851d-179c01ee77a0 in Status: SUCCESS [ 1115.217121] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c8ff43e-9a83-418c-851d-179c01ee77a0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.470282] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.470548] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.470675] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.470996] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.471196] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.471358] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Segment Port 14e5f0ad-93b4-429a-b62d-2004377d1584 not found, creating... [ 1115.472360] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.472360] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.472360] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.472360] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.472360] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.472565] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.472710] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.472829] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.474013] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.474217] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.474433] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Resource: SegmentPort with ID: 14e5f0ad-93b4-429a-b62d-2004377d1584 is going to be created. [ 1115.498216] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.499699] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.499852] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.500180] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.500419] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.500679] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "port-14e5f0ad-93b4-429a-b62d-2004377d1584" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.807924] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 in Status: SUCCESS [ 1115.808675] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.808675] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.808675] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.808871] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.808930] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.808965] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.809128] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.809203] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.809297] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.988130] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 in Status: SUCCESS [ 1115.988435] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.988566] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.988801] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.988986] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.989175] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.989249] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.989370] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.989452] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.989547] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.989751] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('401f7079-c4c2-4951-b6ae-bc1cfbb23228',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.127296] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8869e0a-9385-48b2-ac90-589c8415df21 in Status: SUCCESS [ 1116.127560] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8869e0a-9385-48b2-ac90-589c8415df21 deletion is rescheduled due to dependency. [ 1116.127661] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.240472] env[65471]: INFO networking_nsxv3.common.synchronization [req-394f05f8-b142-4a6c-826d-deea953017d6 req-54a6cbff-f5f4-45f5-a30c-6b93c3dbca00 service nova] Enqueued Resource ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 with Priority: HIGHEST for action security_group_rules [ 1116.240472] env[65471]: INFO networking_nsxv3.common.synchronization [req-394f05f8-b142-4a6c-826d-deea953017d6 req-54a6cbff-f5f4-45f5-a30c-6b93c3dbca00 service nova] Enqueued Resource ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 with Priority: HIGHEST for action security_group_members [ 1116.240472] env[65471]: INFO networking_nsxv3.common.synchronization [req-394f05f8-b142-4a6c-826d-deea953017d6 req-54a6cbff-f5f4-45f5-a30c-6b93c3dbca00 service nova] Enqueued Resource ID: 14e5f0ad-93b4-429a-b62d-2004377d1584 with Priority: HIGHEST for action port [ 1116.242019] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 with Priority: HIGHEST for action security_group_rules [ 1116.242301] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 with Priority: HIGHEST for action security_group_members [ 1116.242453] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14e5f0ad-93b4-429a-b62d-2004377d1584 with Priority: HIGHEST for action port [ 1116.242848] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c35d5123-3fe1-447f-aedc-8112e5faa2b6 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.242990] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.243073] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.243338] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.243546] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c35d5123-3fe1-447f-aedc-8112e5faa2b6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.245032] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-c35d5123-3fe1-447f-aedc-8112e5faa2b6 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.245194] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.245459] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-14e5f0ad-93b4-429a-b62d-2004377d1584 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.245667] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-14e5f0ad-93b4-429a-b62d-2004377d1584" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.245959] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-14e5f0ad-93b4-429a-b62d-2004377d1584" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.246032] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-14e5f0ad-93b4-429a-b62d-2004377d1584" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.246464] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14e5f0ad-93b4-429a-b62d-2004377d1584',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.311283] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.491833] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('401f7079-c4c2-4951-b6ae-bc1cfbb23228',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.513719] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c92cf42-7023-4aba-91c3-95f84d379c9f in Status: SUCCESS [ 1116.513925] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c92cf42-7023-4aba-91c3-95f84d379c9f deletion is rescheduled due to dependency. [ 1116.514061] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c92cf42-7023-4aba-91c3-95f84d379c9f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.748788] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-c35d5123-3fe1-447f-aedc-8112e5faa2b6 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.748788] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.750572] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 14e5f0ad-93b4-429a-b62d-2004377d1584 with status ACTIVE [ 1116.750572] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.750572] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.750572] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.750572] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.751039] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.751039] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.751039] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.751039] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.751176] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.751176] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.751410] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.751526] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.751526] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.751653] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.751691] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.751775] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 14e5f0ad-93b4-429a-b62d-2004377d1584 is going to be updated. [ 1116.778312] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.778533] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.778639] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.778888] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.779091] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.779304] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-14e5f0ad-93b4-429a-b62d-2004377d1584" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.813193] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.994135] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 401f7079-c4c2-4951-b6ae-bc1cfbb23228: rpc.has_security_group_logging(os_id): False [ 1117.013288] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.013512] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.013512] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.013695] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.013779] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.014094] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.014222] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.014277] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.014423] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.014499] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.014591] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 is going to be updated. [ 1117.086356] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.086553] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.086650] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.086838] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.086980] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.101784] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 in Status: IN_PROGRESS for 2s [ 1117.179848] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 in Status: SUCCESS [ 1117.180114] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 deletion is rescheduled due to dependency. [ 1117.180114] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.180267] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.180517] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.180712] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.181120] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.181120] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.181120] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.181241] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.181295] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c35d5123-3fe1-447f-aedc-8112e5faa2b6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.298561] env[65471]: INFO networking_nsxv3.common.synchronization [None req-c0760507-eee5-4524-88f7-de12cea67096 tempest-AttachVolumeNegativeTest-275281664 tempest-AttachVolumeNegativeTest-275281664-project-member] Enqueued Resource ID: ba0eaf1c-cef3-41f3-a334-f5b6dbf38966 with Priority: HIGHEST for action security_group_rules [ 1117.299271] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba0eaf1c-cef3-41f3-a334-f5b6dbf38966 with Priority: HIGHEST for action security_group_rules [ 1117.299650] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ba0eaf1c-cef3-41f3-a334-f5b6dbf38966 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.299723] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ba0eaf1c-cef3-41f3-a334-f5b6dbf38966" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.299796] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ba0eaf1c-cef3-41f3-a334-f5b6dbf38966" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.300066] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ba0eaf1c-cef3-41f3-a334-f5b6dbf38966" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.300163] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ba0eaf1c-cef3-41f3-a334-f5b6dbf38966',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.315875] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.316038] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.316104] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.316481] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.316481] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.316481] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 is going to be updated. [ 1117.349471] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.349830] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.349830] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.350063] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.350218] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.359688] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 in Status: IN_PROGRESS for 2s [ 1117.402045] env[65471]: INFO networking_nsxv3.common.synchronization [None req-63113ead-9f5a-4111-b1f2-b6a7368fd39c tempest-AttachVolumeNegativeTest-275281664 tempest-AttachVolumeNegativeTest-275281664-project-member] Enqueued Resource ID: ba0eaf1c-cef3-41f3-a334-f5b6dbf38966 with Priority: HIGHEST for action security_group_rules [ 1117.402612] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba0eaf1c-cef3-41f3-a334-f5b6dbf38966 with Priority: HIGHEST for action security_group_rules [ 1117.402948] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ba0eaf1c-cef3-41f3-a334-f5b6dbf38966 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.403156] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ba0eaf1c-cef3-41f3-a334-f5b6dbf38966" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.685532] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c35d5123-3fe1-447f-aedc-8112e5faa2b6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.832496] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.832673] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.832781] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.832951] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.833046] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.833144] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ba0eaf1c-cef3-41f3-a334-f5b6dbf38966 already deleted. [ 1117.833234] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ba0eaf1c-cef3-41f3-a334-f5b6dbf38966" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.833392] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ba0eaf1c-cef3-41f3-a334-f5b6dbf38966" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.833550] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ba0eaf1c-cef3-41f3-a334-f5b6dbf38966" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.833636] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ba0eaf1c-cef3-41f3-a334-f5b6dbf38966',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.187544] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c35d5123-3fe1-447f-aedc-8112e5faa2b6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.355890] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.356130] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.356655] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.356719] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.356868] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.357017] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ba0eaf1c-cef3-41f3-a334-f5b6dbf38966 already deleted. [ 1118.357147] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ba0eaf1c-cef3-41f3-a334-f5b6dbf38966" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.690905] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.690905] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.690905] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.690905] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.690905] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.690905] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 is going to be updated. [ 1118.722793] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.722793] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.722793] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.723094] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.723320] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.734731] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 in Status: IN_PROGRESS for 2s [ 1119.118745] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 in Status: SUCCESS [ 1119.118988] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.375812] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 in Status: SUCCESS [ 1119.376083] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.376286] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.376575] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.376896] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.376896] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.377059] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.377120] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.377203] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.377289] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.377383] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.879870] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-735019a1-4315-46a6-b3c7-ec71fdc6ef33 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.880045] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.880139] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.880354] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.880532] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.880642] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.880778] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.880853] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.880936] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.881037] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.881185] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-735019a1-4315-46a6-b3c7-ec71fdc6ef33 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.881280] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.881341] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.881479] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.881616] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.881705] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.881766] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.881920] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.882000] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.882112] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.882204] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.385547] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 735019a1-4315-46a6-b3c7-ec71fdc6ef33: rpc.has_security_group_logging(os_id): False [ 1120.404535] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.404746] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.404746] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.404956] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.405138] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.405492] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.405646] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.405720] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.405895] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.405978] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.406198] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.406329] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.406428] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.406572] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.406648] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.406844] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.406937] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.406988] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.407248] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.407338] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.407424] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 is going to be updated. [ 1120.477878] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.478093] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.478208] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.478468] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.478651] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.506312] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 in Status: IN_PROGRESS for 2s [ 1120.746477] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 in Status: SUCCESS [ 1120.746720] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.746896] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.747133] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.747325] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.747439] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.747502] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.747657] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.747738] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.747822] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.747915] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c35d5123-3fe1-447f-aedc-8112e5faa2b6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.250172] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-c35d5123-3fe1-447f-aedc-8112e5faa2b6 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.250381] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.250500] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.250868] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.251091] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.251206] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.251284] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.251483] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.251573] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.251725] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.251862] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-c35d5123-3fe1-447f-aedc-8112e5faa2b6 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.251955] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.252029] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.252176] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.252366] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.252467] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.252530] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.252679] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.252816] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.252878] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.252998] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c35d5123-3fe1-447f-aedc-8112e5faa2b6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.755617] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c35d5123-3fe1-447f-aedc-8112e5faa2b6: rpc.has_security_group_logging(os_id): False [ 1121.773075] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.773259] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.773326] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.773494] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.773579] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.773771] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.773920] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.773920] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.774209] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.774357] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.774596] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.774706] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.774774] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.774940] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.775115] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.775344] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.775455] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.775520] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.775672] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.775748] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.775837] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 is going to be updated. [ 1121.833649] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.833787] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.833862] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.834171] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.834480] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.851676] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 in Status: IN_PROGRESS for 2s [ 1122.403378] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1122.403484] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1122.523063] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 in Status: SUCCESS [ 1122.523185] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.871295] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 in Status: SUCCESS [ 1123.871664] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.475301] env[65471]: INFO networking_nsxv3.common.synchronization [req-df8fcddf-cc1f-4682-8cb3-d930d82227ad req-7b7696b3-ccad-4ac3-86b4-127c7e7fa233 tempest-ListImageFiltersTestJSON-417187835 tempest-ListImageFiltersTestJSON-417187835-project-member] Enqueued Resource ID: 2c8ff43e-9a83-418c-851d-179c01ee77a0 with Priority: HIGHEST for action security_group_members [ 1125.475870] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c8ff43e-9a83-418c-851d-179c01ee77a0 with Priority: HIGHEST for action security_group_members [ 1125.476217] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c8ff43e-9a83-418c-851d-179c01ee77a0 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.476346] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c8ff43e-9a83-418c-851d-179c01ee77a0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.476415] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c8ff43e-9a83-418c-851d-179c01ee77a0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.476608] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c8ff43e-9a83-418c-851d-179c01ee77a0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.476763] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.476864] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.476922] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.477077] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.477162] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.477259] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c8ff43e-9a83-418c-851d-179c01ee77a0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.979827] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.980792] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.980792] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.980792] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.980792] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.980792] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.980792] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.980792] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.981259] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.981259] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.981259] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c8ff43e-9a83-418c-851d-179c01ee77a0 is going to be updated. [ 1126.011805] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.011979] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.012054] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.012260] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.012402] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.020630] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c8ff43e-9a83-418c-851d-179c01ee77a0 in Status: IN_PROGRESS for 2s [ 1128.032231] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c8ff43e-9a83-418c-851d-179c01ee77a0 in Status: SUCCESS [ 1128.032576] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c8ff43e-9a83-418c-851d-179c01ee77a0 deletion is rescheduled due to dependency. [ 1128.032576] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c8ff43e-9a83-418c-851d-179c01ee77a0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.299645] env[65471]: INFO networking_nsxv3.common.synchronization [req-25f5e57a-4d64-4d3b-b872-3bed6fa45d6f req-5301dc3f-7acd-4cef-a25c-1516db9a46ec tempest-ServersTestJSON-569130442 tempest-ServersTestJSON-569130442-project-member] Enqueued Resource ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 with Priority: HIGHEST for action security_group_members [ 1128.300235] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 with Priority: HIGHEST for action security_group_members [ 1128.300561] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-735019a1-4315-46a6-b3c7-ec71fdc6ef33 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.300688] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.300759] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.300959] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.301293] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.301454] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.301487] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.301643] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.301727] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.301826] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.804451] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.307475] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.810528] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.810528] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.810528] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.810528] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.810867] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.810962] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 is going to be updated. [ 1129.849833] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.850045] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.850090] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.850297] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.850644] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.860846] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 in Status: IN_PROGRESS for 2s [ 1130.125285] env[65471]: INFO networking_nsxv3.common.synchronization [req-179f90a5-522e-4ee6-9b2c-6c43447a858d req-20883d66-1b0f-4ce7-a382-97e57af87731 tempest-DeleteServersTestJSON-72429361 tempest-DeleteServersTestJSON-72429361-project-member] Enqueued Resource ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 with Priority: HIGHEST for action security_group_members [ 1130.125336] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 with Priority: HIGHEST for action security_group_members [ 1130.126037] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-c35d5123-3fe1-447f-aedc-8112e5faa2b6 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.126169] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.126240] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.126439] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.126604] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.126700] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.126762] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.126912] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.126998] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.127130] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c35d5123-3fe1-447f-aedc-8112e5faa2b6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.629533] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.629801] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.629876] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.630062] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.630237] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.630441] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.630542] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.630619] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.630900] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.630998] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.631107] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 is going to be updated. [ 1130.662548] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.662723] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.662814] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.663075] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.663252] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.674299] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 in Status: IN_PROGRESS for 2s [ 1130.728209] env[65471]: INFO networking_nsxv3.common.synchronization [req-5706c57c-fa63-44c5-bb67-8823293f96f2 req-d33a7a39-648d-4db4-b3d5-e252aee7794a tempest-AttachVolumeNegativeTest-275281664 tempest-AttachVolumeNegativeTest-275281664-project-member] Enqueued Resource ID: ba0eaf1c-cef3-41f3-a334-f5b6dbf38966 with Priority: HIGHEST for action security_group_members [ 1130.729275] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba0eaf1c-cef3-41f3-a334-f5b6dbf38966 with Priority: HIGHEST for action security_group_members [ 1130.729275] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba0eaf1c-cef3-41f3-a334-f5b6dbf38966 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.730733] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba0eaf1c-cef3-41f3-a334-f5b6dbf38966" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.730733] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba0eaf1c-cef3-41f3-a334-f5b6dbf38966" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.730733] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba0eaf1c-cef3-41f3-a334-f5b6dbf38966" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.730733] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.730934] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.730934] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.731079] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.731166] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.731265] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba0eaf1c-cef3-41f3-a334-f5b6dbf38966',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.082104] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock network-507 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.082367] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "network-507" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.082502] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "network-507" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.082908] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "network-507" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.082999] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.083196] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.083323] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.083525] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.083667] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.083871] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1131.083982] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1131.084102] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1131.084233] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1131.084560] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1131.084560] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1131.084704] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1131.104895] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1131.104895] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1131.104895] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1131.105071] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "network-507" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.105348] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock port-5e2ed64d-02f4-4033-8983-b2f30b9515dc taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.105525] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "port-5e2ed64d-02f4-4033-8983-b2f30b9515dc" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.105640] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "port-5e2ed64d-02f4-4033-8983-b2f30b9515dc" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.106092] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "port-5e2ed64d-02f4-4033-8983-b2f30b9515dc" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.106228] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e2ed64d-02f4-4033-8983-b2f30b9515dc',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.236216] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.236468] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.236612] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.236943] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.237099] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.237353] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.237468] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.237548] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.237789] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.237924] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.238079] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba0eaf1c-cef3-41f3-a334-f5b6dbf38966 already deleted. [ 1131.238222] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba0eaf1c-cef3-41f3-a334-f5b6dbf38966" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.609172] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.609548] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.609794] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.609983] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.610184] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.610350] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Segment Port 5e2ed64d-02f4-4033-8983-b2f30b9515dc not found, creating... [ 1131.611015] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.611015] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.611015] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.611261] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.611319] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.611618] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.611761] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.611893] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.612093] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.612257] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.613031] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Resource: SegmentPort with ID: 5e2ed64d-02f4-4033-8983-b2f30b9515dc is going to be created. [ 1131.633164] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.633481] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.633529] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.633761] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.633984] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.634360] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "port-5e2ed64d-02f4-4033-8983-b2f30b9515dc" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.870444] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 in Status: SUCCESS [ 1131.870688] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.362703] env[65471]: INFO networking_nsxv3.common.synchronization [req-5706c57c-fa63-44c5-bb67-8823293f96f2 req-6941f8ac-feeb-4639-aac5-1804fe52ee71 service nova] Enqueued Resource ID: ba0eaf1c-cef3-41f3-a334-f5b6dbf38966 with Priority: HIGHEST for action security_group_rules [ 1132.362878] env[65471]: INFO networking_nsxv3.common.synchronization [req-5706c57c-fa63-44c5-bb67-8823293f96f2 req-6941f8ac-feeb-4639-aac5-1804fe52ee71 service nova] Enqueued Resource ID: ba0eaf1c-cef3-41f3-a334-f5b6dbf38966 with Priority: HIGHEST for action security_group_members [ 1132.363018] env[65471]: INFO networking_nsxv3.common.synchronization [req-5706c57c-fa63-44c5-bb67-8823293f96f2 req-6941f8ac-feeb-4639-aac5-1804fe52ee71 service nova] Enqueued Resource ID: 5e2ed64d-02f4-4033-8983-b2f30b9515dc with Priority: HIGHEST for action port [ 1132.363577] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba0eaf1c-cef3-41f3-a334-f5b6dbf38966 with Priority: HIGHEST for action security_group_rules [ 1132.363707] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba0eaf1c-cef3-41f3-a334-f5b6dbf38966 with Priority: HIGHEST for action security_group_members [ 1132.363801] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e2ed64d-02f4-4033-8983-b2f30b9515dc with Priority: HIGHEST for action port [ 1132.364364] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ba0eaf1c-cef3-41f3-a334-f5b6dbf38966 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.364493] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ba0eaf1c-cef3-41f3-a334-f5b6dbf38966" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.364557] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ba0eaf1c-cef3-41f3-a334-f5b6dbf38966" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.364755] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ba0eaf1c-cef3-41f3-a334-f5b6dbf38966" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.364833] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ba0eaf1c-cef3-41f3-a334-f5b6dbf38966',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.365698] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba0eaf1c-cef3-41f3-a334-f5b6dbf38966 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.365798] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba0eaf1c-cef3-41f3-a334-f5b6dbf38966" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.365860] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba0eaf1c-cef3-41f3-a334-f5b6dbf38966" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.366026] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba0eaf1c-cef3-41f3-a334-f5b6dbf38966" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.366168] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.366256] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.366314] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.366449] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.366525] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.366613] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba0eaf1c-cef3-41f3-a334-f5b6dbf38966',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.367357] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-5e2ed64d-02f4-4033-8983-b2f30b9515dc taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.367454] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5e2ed64d-02f4-4033-8983-b2f30b9515dc" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.367514] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5e2ed64d-02f4-4033-8983-b2f30b9515dc" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.367695] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5e2ed64d-02f4-4033-8983-b2f30b9515dc" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.367731] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e2ed64d-02f4-4033-8983-b2f30b9515dc',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.687637] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 in Status: SUCCESS [ 1132.687996] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 deletion is rescheduled due to dependency. [ 1132.687996] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.869537] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba0eaf1c-cef3-41f3-a334-f5b6dbf38966 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.869766] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba0eaf1c-cef3-41f3-a334-f5b6dbf38966" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.869969] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ba0eaf1c-cef3-41f3-a334-f5b6dbf38966',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.871141] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5e2ed64d-02f4-4033-8983-b2f30b9515dc with status ACTIVE [ 1132.871240] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.871297] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.871368] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.871533] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.871619] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.871808] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.871878] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.871938] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.872126] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.872320] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.872560] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.872670] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.872742] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.872900] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.872987] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.873081] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5e2ed64d-02f4-4033-8983-b2f30b9515dc is going to be updated. [ 1132.898757] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.898966] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.898966] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.899126] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.899266] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.899467] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5e2ed64d-02f4-4033-8983-b2f30b9515dc" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.376642] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ba0eaf1c-cef3-41f3-a334-f5b6dbf38966',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.880052] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.880421] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.880421] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.881647] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.881647] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.881647] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba0eaf1c-cef3-41f3-a334-f5b6dbf38966 is going to be created. [ 1133.906910] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.907511] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.907594] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.907837] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.908018] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.919394] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba0eaf1c-cef3-41f3-a334-f5b6dbf38966 in Status: UNINITIALIZED for 2s [ 1134.505351] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock network-238 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.505691] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "network-238" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.505939] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "network-238" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.506324] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "network-238" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.506753] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.506986] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.507261] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.507537] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.507781] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.508148] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1134.508362] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1134.508565] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1134.508759] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1134.508955] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1134.509180] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1134.509411] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1134.535302] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1134.535558] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1134.535643] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1134.535831] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "network-238" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.536267] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock port-7b1b7f29-3007-4180-8a5a-865009336243 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.536449] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "port-7b1b7f29-3007-4180-8a5a-865009336243" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.536571] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "port-7b1b7f29-3007-4180-8a5a-865009336243" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.537120] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "port-7b1b7f29-3007-4180-8a5a-865009336243" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.537288] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b1b7f29-3007-4180-8a5a-865009336243',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.043034] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.043034] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.043034] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.043034] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.043034] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.043034] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Segment Port 7b1b7f29-3007-4180-8a5a-865009336243 not found, creating... [ 1135.043034] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.043034] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.043034] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.043034] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.043034] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.043783] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.043783] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.043783] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.043783] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.043783] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.043783] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Resource: SegmentPort with ID: 7b1b7f29-3007-4180-8a5a-865009336243 is going to be created. [ 1135.072313] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.072313] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.072313] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.072313] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.072313] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.072313] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "port-7b1b7f29-3007-4180-8a5a-865009336243" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.521251] env[65471]: INFO networking_nsxv3.common.synchronization [None req-1c41a595-4f6d-4c28-b9e1-54991dbc83f5 None None] Enqueued Resource ID: 2aa7b222-0812-4644-aa75-9005962ea3d6 with Priority: HIGHEST for action port [ 1135.521845] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2aa7b222-0812-4644-aa75-9005962ea3d6 with Priority: HIGHEST for action port [ 1135.522441] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-2aa7b222-0812-4644-aa75-9005962ea3d6 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.522599] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2aa7b222-0812-4644-aa75-9005962ea3d6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.522671] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2aa7b222-0812-4644-aa75-9005962ea3d6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.523040] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2aa7b222-0812-4644-aa75-9005962ea3d6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.523144] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2aa7b222-0812-4644-aa75-9005962ea3d6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.786502] env[65471]: INFO networking_nsxv3.common.synchronization [req-4421751e-9ea6-4059-8245-9428c0f7eefb req-fceeb2a0-21b3-4cdc-9424-a2ed0fcd9b43 service nova] Enqueued Resource ID: e8869e0a-9385-48b2-ac90-589c8415df21 with Priority: HIGHEST for action security_group_rules [ 1135.786730] env[65471]: INFO networking_nsxv3.common.synchronization [req-4421751e-9ea6-4059-8245-9428c0f7eefb req-fceeb2a0-21b3-4cdc-9424-a2ed0fcd9b43 service nova] Enqueued Resource ID: e8869e0a-9385-48b2-ac90-589c8415df21 with Priority: HIGHEST for action security_group_members [ 1135.786890] env[65471]: INFO networking_nsxv3.common.synchronization [req-4421751e-9ea6-4059-8245-9428c0f7eefb req-fceeb2a0-21b3-4cdc-9424-a2ed0fcd9b43 service nova] Enqueued Resource ID: 7b1b7f29-3007-4180-8a5a-865009336243 with Priority: HIGHEST for action port [ 1135.787471] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8869e0a-9385-48b2-ac90-589c8415df21 with Priority: HIGHEST for action security_group_rules [ 1135.787948] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8869e0a-9385-48b2-ac90-589c8415df21 with Priority: HIGHEST for action security_group_members [ 1135.787948] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b1b7f29-3007-4180-8a5a-865009336243 with Priority: HIGHEST for action port [ 1135.788081] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e8869e0a-9385-48b2-ac90-589c8415df21 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.788218] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.788287] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.788573] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.788650] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e8869e0a-9385-48b2-ac90-589c8415df21',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.789634] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8869e0a-9385-48b2-ac90-589c8415df21 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.789778] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.789822] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.789984] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.790144] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.790235] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.790370] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.790446] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.790542] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.790632] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e8869e0a-9385-48b2-ac90-589c8415df21',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.791789] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-7b1b7f29-3007-4180-8a5a-865009336243 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.791907] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7b1b7f29-3007-4180-8a5a-865009336243" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.791963] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7b1b7f29-3007-4180-8a5a-865009336243" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.792133] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7b1b7f29-3007-4180-8a5a-865009336243" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.792207] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b1b7f29-3007-4180-8a5a-865009336243',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.932293] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba0eaf1c-cef3-41f3-a334-f5b6dbf38966 in Status: SUCCESS [ 1135.932733] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba0eaf1c-cef3-41f3-a334-f5b6dbf38966" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.932733] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba0eaf1c-cef3-41f3-a334-f5b6dbf38966" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.933100] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba0eaf1c-cef3-41f3-a334-f5b6dbf38966" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.933335] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.933470] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.933541] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.933706] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.933815] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.933862] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba0eaf1c-cef3-41f3-a334-f5b6dbf38966" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.934091] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ba0eaf1c-cef3-41f3-a334-f5b6dbf38966',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.030235] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2aa7b222-0812-4644-aa75-9005962ea3d6 [ 1136.030503] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.030637] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.030716] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.030979] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.031071] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.031136] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2aa7b222-0812-4644-aa75-9005962ea3d6 already deleted. [ 1136.031216] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2aa7b222-0812-4644-aa75-9005962ea3d6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.269456] env[65471]: INFO networking_nsxv3.common.synchronization [req-a5a8aa4c-132a-4723-8ab1-707615f2bf99 req-0c359a34-f36c-43be-9ece-65ed65434534 tempest-ServerActionsTestOtherA-1623203122 tempest-ServerActionsTestOtherA-1623203122-project-member] Enqueued Resource ID: e7122ab9-4313-4173-8869-cf7cd16cccf0 with Priority: HIGHEST for action security_group_members [ 1136.270463] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7122ab9-4313-4173-8869-cf7cd16cccf0 with Priority: HIGHEST for action security_group_members [ 1136.270814] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7122ab9-4313-4173-8869-cf7cd16cccf0 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.270979] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7122ab9-4313-4173-8869-cf7cd16cccf0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.271140] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7122ab9-4313-4173-8869-cf7cd16cccf0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.271336] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7122ab9-4313-4173-8869-cf7cd16cccf0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.271507] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.271631] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.271695] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.271856] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.271941] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.272087] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7122ab9-4313-4173-8869-cf7cd16cccf0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.293632] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8869e0a-9385-48b2-ac90-589c8415df21 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.293814] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.294095] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e8869e0a-9385-48b2-ac90-589c8415df21',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.295136] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7b1b7f29-3007-4180-8a5a-865009336243 with status ACTIVE [ 1136.295571] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.295673] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.295710] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.295999] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.296136] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.296328] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.296420] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.296460] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.296617] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.296694] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.296902] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.297050] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.297556] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.297711] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.297801] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.297881] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7b1b7f29-3007-4180-8a5a-865009336243 is going to be updated. [ 1136.333778] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.333778] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.333778] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.333778] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.333778] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.333778] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7b1b7f29-3007-4180-8a5a-865009336243" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.339379] env[65471]: INFO networking_nsxv3.common.synchronization [req-bfbf05df-be61-4f4f-a6ff-8bed6148c9ca req-4f7d440d-9987-46a5-90de-cebe7def6c6c tempest-ServerActionsTestOtherB-402089456 tempest-ServerActionsTestOtherB-402089456-project-member] Enqueued Resource ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 with Priority: HIGHEST for action security_group_members [ 1136.339575] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 with Priority: HIGHEST for action security_group_members [ 1136.339905] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-b71ce0e0-83fe-4f36-8617-e29f83b0be32 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.340037] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.340107] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.340303] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.340471] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.340584] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.340618] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.340756] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.340871] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.340984] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b71ce0e0-83fe-4f36-8617-e29f83b0be32',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.436275] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ba0eaf1c-cef3-41f3-a334-f5b6dbf38966',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.766673] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock network-344 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.766673] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "network-344" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.766673] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "network-344" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.767595] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "network-344" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.767745] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.767970] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.768250] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.768611] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.768763] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.769028] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1136.769167] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1136.769342] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1136.769447] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1136.769592] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1136.769730] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1136.769910] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1136.774528] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.774660] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.774734] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.774909] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.774995] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.775189] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.775308] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.775345] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.775480] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.775556] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.775642] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7122ab9-4313-4173-8869-cf7cd16cccf0 is going to be deleted. [ 1136.797982] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1136.798207] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1136.798319] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1136.798513] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "network-344" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.798836] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock port-666354e9-a5d0-4ded-b598-05af4f52e88a taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.799017] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "port-666354e9-a5d0-4ded-b598-05af4f52e88a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.799140] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "port-666354e9-a5d0-4ded-b598-05af4f52e88a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.799485] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "port-666354e9-a5d0-4ded-b598-05af4f52e88a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.799626] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('666354e9-a5d0-4ded-b598-05af4f52e88a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.805746] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e8869e0a-9385-48b2-ac90-589c8415df21',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.809983] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.810128] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.810199] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.810408] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.810502] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.810593] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7122ab9-4313-4173-8869-cf7cd16cccf0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.843966] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.844117] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.844185] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.844432] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.871425] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.872802] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.872802] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.872802] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.872802] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.872802] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.872802] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 is going to be updated. [ 1136.899996] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.900147] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.902022] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.902022] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.902022] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.910967] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 in Status: IN_PROGRESS for 2s [ 1136.939480] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ba0eaf1c-cef3-41f3-a334-f5b6dbf38966: rpc.has_security_group_logging(os_id): False [ 1136.961065] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.961065] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.961065] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.961065] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.961065] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.961065] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.961065] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.961065] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.961065] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.961065] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.961065] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ba0eaf1c-cef3-41f3-a334-f5b6dbf38966 is going to be created. [ 1137.023732] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.023896] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.023943] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.024181] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.024402] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.039588] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ba0eaf1c-cef3-41f3-a334-f5b6dbf38966 in Status: IN_PROGRESS for 2s [ 1137.305024] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.305024] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.305024] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.305024] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.305024] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.305024] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Segment Port 666354e9-a5d0-4ded-b598-05af4f52e88a not found, creating... [ 1137.305024] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.305024] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.305024] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.305024] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.305024] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.306212] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.306516] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.306762] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.307178] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.307900] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.308237] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Resource: SegmentPort with ID: 666354e9-a5d0-4ded-b598-05af4f52e88a is going to be created. [ 1137.312160] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.312160] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.312160] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.312160] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.312160] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.312160] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8869e0a-9385-48b2-ac90-589c8415df21 is going to be updated. [ 1137.351753] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.351972] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.352550] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.353012] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.353283] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.353559] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "port-666354e9-a5d0-4ded-b598-05af4f52e88a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.379690] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.379690] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.379690] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.379915] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.379997] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.394556] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8869e0a-9385-48b2-ac90-589c8415df21 in Status: IN_PROGRESS for 2s [ 1138.052940] env[65471]: INFO networking_nsxv3.common.synchronization [req-a5a8aa4c-132a-4723-8ab1-707615f2bf99 req-75ab1293-f19f-4556-8055-d17dd6deed35 service nova] Enqueued Resource ID: e7122ab9-4313-4173-8869-cf7cd16cccf0 with Priority: HIGHEST for action security_group_rules [ 1138.053228] env[65471]: INFO networking_nsxv3.common.synchronization [req-a5a8aa4c-132a-4723-8ab1-707615f2bf99 req-75ab1293-f19f-4556-8055-d17dd6deed35 service nova] Enqueued Resource ID: e7122ab9-4313-4173-8869-cf7cd16cccf0 with Priority: HIGHEST for action security_group_members [ 1138.053421] env[65471]: INFO networking_nsxv3.common.synchronization [req-a5a8aa4c-132a-4723-8ab1-707615f2bf99 req-75ab1293-f19f-4556-8055-d17dd6deed35 service nova] Enqueued Resource ID: 666354e9-a5d0-4ded-b598-05af4f52e88a with Priority: HIGHEST for action port [ 1138.053934] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7122ab9-4313-4173-8869-cf7cd16cccf0 with Priority: HIGHEST for action security_group_rules [ 1138.054125] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7122ab9-4313-4173-8869-cf7cd16cccf0 with Priority: HIGHEST for action security_group_members [ 1138.054705] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 666354e9-a5d0-4ded-b598-05af4f52e88a with Priority: HIGHEST for action port [ 1138.055065] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e7122ab9-4313-4173-8869-cf7cd16cccf0 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.055202] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e7122ab9-4313-4173-8869-cf7cd16cccf0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.055266] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e7122ab9-4313-4173-8869-cf7cd16cccf0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.055484] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e7122ab9-4313-4173-8869-cf7cd16cccf0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.055571] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e7122ab9-4313-4173-8869-cf7cd16cccf0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.056644] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7122ab9-4313-4173-8869-cf7cd16cccf0 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.221764] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7122ab9-4313-4173-8869-cf7cd16cccf0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.221764] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7122ab9-4313-4173-8869-cf7cd16cccf0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.222773] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7122ab9-4313-4173-8869-cf7cd16cccf0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.223014] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.223162] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.223245] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.223486] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.223596] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.223750] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7122ab9-4313-4173-8869-cf7cd16cccf0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.224926] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-666354e9-a5d0-4ded-b598-05af4f52e88a taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.225100] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-666354e9-a5d0-4ded-b598-05af4f52e88a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.225149] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-666354e9-a5d0-4ded-b598-05af4f52e88a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.225336] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-666354e9-a5d0-4ded-b598-05af4f52e88a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.226513] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('666354e9-a5d0-4ded-b598-05af4f52e88a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.686721] env[65471]: INFO networking_nsxv3.common.synchronization [None req-2719f07d-238b-41e7-80de-c67c0d44dbed None None] Enqueued Resource ID: 2a4f39e3-d066-41c3-affd-a08da2575476 with Priority: HIGHEST for action port [ 1138.687546] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a4f39e3-d066-41c3-affd-a08da2575476 with Priority: HIGHEST for action port [ 1138.687707] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-2a4f39e3-d066-41c3-affd-a08da2575476 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.687707] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2a4f39e3-d066-41c3-affd-a08da2575476" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.687884] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2a4f39e3-d066-41c3-affd-a08da2575476" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.688031] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2a4f39e3-d066-41c3-affd-a08da2575476" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.688117] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a4f39e3-d066-41c3-affd-a08da2575476',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.727597] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7122ab9-4313-4173-8869-cf7cd16cccf0 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.727793] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7122ab9-4313-4173-8869-cf7cd16cccf0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.727854] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e7122ab9-4313-4173-8869-cf7cd16cccf0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.728763] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 666354e9-a5d0-4ded-b598-05af4f52e88a with status ACTIVE [ 1138.728947] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.729074] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.729130] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.729332] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.729416] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.729595] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.729754] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.729754] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.729878] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.729958] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.730143] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.730251] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.730316] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.730419] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.730498] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.730572] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 666354e9-a5d0-4ded-b598-05af4f52e88a is going to be updated. [ 1138.756246] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.756520] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.756520] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.756677] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.756841] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.757040] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-666354e9-a5d0-4ded-b598-05af4f52e88a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.921921] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 in Status: SUCCESS [ 1138.922081] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 deletion is rescheduled due to dependency. [ 1138.922314] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.051548] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ba0eaf1c-cef3-41f3-a334-f5b6dbf38966 in Status: SUCCESS [ 1139.051790] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ba0eaf1c-cef3-41f3-a334-f5b6dbf38966" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.190808] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2a4f39e3-d066-41c3-affd-a08da2575476 [ 1139.191274] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.191448] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.191448] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.191595] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.191690] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.191772] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2a4f39e3-d066-41c3-affd-a08da2575476 already deleted. [ 1139.191906] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2a4f39e3-d066-41c3-affd-a08da2575476" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.232996] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e7122ab9-4313-4173-8869-cf7cd16cccf0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.404322] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8869e0a-9385-48b2-ac90-589c8415df21 in Status: SUCCESS [ 1139.404322] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.404494] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.404713] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.404908] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.405052] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.405099] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.405259] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.405339] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.405465] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.405587] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e8869e0a-9385-48b2-ac90-589c8415df21',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.735327] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.736100] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.736100] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.736100] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.736100] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.736100] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7122ab9-4313-4173-8869-cf7cd16cccf0 is going to be created. [ 1139.761776] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.762022] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.762022] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.762769] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.762769] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.775991] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7122ab9-4313-4173-8869-cf7cd16cccf0 in Status: UNINITIALIZED for 2s [ 1139.907872] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8869e0a-9385-48b2-ac90-589c8415df21 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.909150] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.909150] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.909150] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.909150] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.909150] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.909150] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.909415] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.909456] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.909609] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.909848] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8869e0a-9385-48b2-ac90-589c8415df21 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.909987] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.910105] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.910291] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.910537] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.910687] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.910854] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.911057] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.911185] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.911318] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.911491] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e8869e0a-9385-48b2-ac90-589c8415df21',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.056982] env[65471]: INFO networking_nsxv3.common.synchronization [req-a83954c6-e117-4306-87a7-0a1b6f6f72de req-7a591170-c97b-439d-9dee-18fd442d9b8b tempest-ServersTestJSON-569130442 tempest-ServersTestJSON-569130442-project-member] Enqueued Resource ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 with Priority: HIGHEST for action security_group_members [ 1140.057959] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 with Priority: HIGHEST for action security_group_members [ 1140.058305] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-735019a1-4315-46a6-b3c7-ec71fdc6ef33 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.058421] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.059731] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.059731] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.059731] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.059731] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.059731] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.059731] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.059731] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.059731] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.414028] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e8869e0a-9385-48b2-ac90-589c8415df21: rpc.has_security_group_logging(os_id): False [ 1140.434267] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.434471] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.435745] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.435745] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.435745] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.435745] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.435745] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.435745] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.435745] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.435745] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.436255] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.436255] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.436255] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.436398] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.436398] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.436636] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.436739] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.436819] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.436969] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.437049] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.437140] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e8869e0a-9385-48b2-ac90-589c8415df21 is going to be updated. [ 1140.498408] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.498580] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.498639] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.500055] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.500055] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.514902] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e8869e0a-9385-48b2-ac90-589c8415df21 in Status: IN_PROGRESS for 2s [ 1140.561764] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.063905] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.566615] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.566615] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.566615] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.566836] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.566836] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.566968] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 is going to be updated. [ 1141.596805] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.596979] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.597083] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.597326] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.597541] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.608704] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 in Status: IN_PROGRESS for 2s [ 1141.789280] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7122ab9-4313-4173-8869-cf7cd16cccf0 in Status: SUCCESS [ 1141.789280] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7122ab9-4313-4173-8869-cf7cd16cccf0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.789280] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7122ab9-4313-4173-8869-cf7cd16cccf0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.789280] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7122ab9-4313-4173-8869-cf7cd16cccf0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.789280] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.789280] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.789280] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.789280] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.789280] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.789280] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7122ab9-4313-4173-8869-cf7cd16cccf0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.789280] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e7122ab9-4313-4173-8869-cf7cd16cccf0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.293113] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7122ab9-4313-4173-8869-cf7cd16cccf0 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.293636] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7122ab9-4313-4173-8869-cf7cd16cccf0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.293636] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7122ab9-4313-4173-8869-cf7cd16cccf0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.293636] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7122ab9-4313-4173-8869-cf7cd16cccf0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.293853] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.293945] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.294024] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.294256] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.294400] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.294464] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7122ab9-4313-4173-8869-cf7cd16cccf0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.294632] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7122ab9-4313-4173-8869-cf7cd16cccf0 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.294730] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7122ab9-4313-4173-8869-cf7cd16cccf0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.294918] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7122ab9-4313-4173-8869-cf7cd16cccf0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.294918] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7122ab9-4313-4173-8869-cf7cd16cccf0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.295058] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.295130] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.295183] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.295336] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.295405] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.295482] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7122ab9-4313-4173-8869-cf7cd16cccf0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.295621] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e7122ab9-4313-4173-8869-cf7cd16cccf0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.532383] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e8869e0a-9385-48b2-ac90-589c8415df21 in Status: SUCCESS [ 1142.532638] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.800995] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e7122ab9-4313-4173-8869-cf7cd16cccf0: rpc.has_security_group_logging(os_id): False [ 1142.826065] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.826211] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.826285] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.826535] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.826651] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.826853] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.826953] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.827028] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.827195] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.827270] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.827499] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.827574] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.827626] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.827764] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.827836] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.828508] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.828679] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.828749] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.828905] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.828981] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.829098] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e7122ab9-4313-4173-8869-cf7cd16cccf0 is going to be created. [ 1142.906859] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.907012] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.907096] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.907390] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.907463] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.928205] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e7122ab9-4313-4173-8869-cf7cd16cccf0 in Status: IN_PROGRESS for 2s [ 1143.619265] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 in Status: SUCCESS [ 1143.619587] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.945804] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e7122ab9-4313-4173-8869-cf7cd16cccf0 in Status: SUCCESS [ 1144.946269] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e7122ab9-4313-4173-8869-cf7cd16cccf0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.059423] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1145.059636] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1145.555925] env[65471]: INFO networking_nsxv3.common.synchronization [req-f2291089-19b5-4075-9b6c-addbece7fa47 req-ef9e47f3-63d6-4b37-b571-e83a4965c1fd tempest-AttachInterfacesV270Test-1055750875 tempest-AttachInterfacesV270Test-1055750875-project-member] Enqueued Resource ID: 57e97084-a75e-460b-85c9-345b90077d12 with Priority: HIGHEST for action security_group_members [ 1145.556956] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57e97084-a75e-460b-85c9-345b90077d12 with Priority: HIGHEST for action security_group_members [ 1145.556956] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-57e97084-a75e-460b-85c9-345b90077d12 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.556956] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57e97084-a75e-460b-85c9-345b90077d12" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.556956] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57e97084-a75e-460b-85c9-345b90077d12" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.557453] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57e97084-a75e-460b-85c9-345b90077d12" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.557621] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.557712] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.557770] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.557925] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.558018] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.558111] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57e97084-a75e-460b-85c9-345b90077d12',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.853583] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock network-450 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.853810] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "network-450" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.853938] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "network-450" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.854280] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "network-450" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.854629] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.854787] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.854903] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.855143] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.855287] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.855503] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1145.855603] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1145.855710] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1145.855813] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1145.856037] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1145.856128] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1145.856259] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1145.878428] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1145.878652] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1145.878820] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1145.878907] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "network-450" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.879259] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock port-23ebaebc-c011-427f-bfad-e81c11e9720c taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.879448] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "port-23ebaebc-c011-427f-bfad-e81c11e9720c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.879533] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "port-23ebaebc-c011-427f-bfad-e81c11e9720c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.879847] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "port-23ebaebc-c011-427f-bfad-e81c11e9720c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.879980] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23ebaebc-c011-427f-bfad-e81c11e9720c',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.061092] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.061413] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.061413] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.061621] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.061709] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.061922] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.062034] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.062100] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.062257] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.062393] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.062501] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57e97084-a75e-460b-85c9-345b90077d12 already deleted. [ 1146.062586] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57e97084-a75e-460b-85c9-345b90077d12" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.382662] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.382868] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.382967] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.383284] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.383442] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.383601] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Segment Port 23ebaebc-c011-427f-bfad-e81c11e9720c not found, creating... [ 1146.383860] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.384026] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.384144] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.384388] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.384815] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.384815] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.385023] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.385064] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.385275] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.385414] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.385562] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Resource: SegmentPort with ID: 23ebaebc-c011-427f-bfad-e81c11e9720c is going to be created. [ 1146.405582] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.405834] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.405894] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.406177] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.406399] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.406617] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "port-23ebaebc-c011-427f-bfad-e81c11e9720c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.141716] env[65471]: INFO networking_nsxv3.common.synchronization [req-f2291089-19b5-4075-9b6c-addbece7fa47 req-6d081923-b63d-4572-9222-1884455d6367 service nova] Enqueued Resource ID: 57e97084-a75e-460b-85c9-345b90077d12 with Priority: HIGHEST for action security_group_rules [ 1147.142096] env[65471]: INFO networking_nsxv3.common.synchronization [req-f2291089-19b5-4075-9b6c-addbece7fa47 req-6d081923-b63d-4572-9222-1884455d6367 service nova] Enqueued Resource ID: 57e97084-a75e-460b-85c9-345b90077d12 with Priority: HIGHEST for action security_group_members [ 1147.142429] env[65471]: INFO networking_nsxv3.common.synchronization [req-f2291089-19b5-4075-9b6c-addbece7fa47 req-6d081923-b63d-4572-9222-1884455d6367 service nova] Enqueued Resource ID: 23ebaebc-c011-427f-bfad-e81c11e9720c with Priority: HIGHEST for action port [ 1147.143154] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57e97084-a75e-460b-85c9-345b90077d12 with Priority: HIGHEST for action security_group_rules [ 1147.143394] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57e97084-a75e-460b-85c9-345b90077d12 with Priority: HIGHEST for action security_group_members [ 1147.143532] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23ebaebc-c011-427f-bfad-e81c11e9720c with Priority: HIGHEST for action port [ 1147.143831] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57e97084-a75e-460b-85c9-345b90077d12 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.143952] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57e97084-a75e-460b-85c9-345b90077d12" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.144032] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57e97084-a75e-460b-85c9-345b90077d12" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.144865] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57e97084-a75e-460b-85c9-345b90077d12" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.144996] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57e97084-a75e-460b-85c9-345b90077d12',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.146740] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-57e97084-a75e-460b-85c9-345b90077d12 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.146864] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57e97084-a75e-460b-85c9-345b90077d12" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.146921] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57e97084-a75e-460b-85c9-345b90077d12" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.147146] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57e97084-a75e-460b-85c9-345b90077d12" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.147301] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.147400] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.147460] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.147605] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.147684] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.147774] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57e97084-a75e-460b-85c9-345b90077d12',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.148805] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-23ebaebc-c011-427f-bfad-e81c11e9720c taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.148917] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23ebaebc-c011-427f-bfad-e81c11e9720c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.148983] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23ebaebc-c011-427f-bfad-e81c11e9720c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.149146] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23ebaebc-c011-427f-bfad-e81c11e9720c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.149221] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23ebaebc-c011-427f-bfad-e81c11e9720c',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.191092] env[65471]: INFO networking_nsxv3.common.synchronization [req-038b899f-5bc1-44b5-bd79-f6795ae53528 req-0be37d54-c960-490e-835d-23e60a64197c tempest-ServerActionsTestOtherA-1623203122 tempest-ServerActionsTestOtherA-1623203122-project-member] Enqueued Resource ID: e7122ab9-4313-4173-8869-cf7cd16cccf0 with Priority: HIGHEST for action security_group_members [ 1147.191564] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7122ab9-4313-4173-8869-cf7cd16cccf0 with Priority: HIGHEST for action security_group_members [ 1147.191894] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7122ab9-4313-4173-8869-cf7cd16cccf0 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.191999] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7122ab9-4313-4173-8869-cf7cd16cccf0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.192648] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7122ab9-4313-4173-8869-cf7cd16cccf0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.192858] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7122ab9-4313-4173-8869-cf7cd16cccf0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.193279] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.193403] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.193469] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.193628] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.193712] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.193813] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7122ab9-4313-4173-8869-cf7cd16cccf0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.254172] env[65471]: INFO networking_nsxv3.common.synchronization [req-038b899f-5bc1-44b5-bd79-f6795ae53528 req-0be37d54-c960-490e-835d-23e60a64197c tempest-ServerActionsTestOtherA-1623203122 tempest-ServerActionsTestOtherA-1623203122-project-member] Enqueued Resource ID: 666354e9-a5d0-4ded-b598-05af4f52e88a with Priority: HIGHEST for action port [ 1147.254172] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 666354e9-a5d0-4ded-b598-05af4f52e88a with Priority: HIGHEST for action port [ 1147.254851] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-666354e9-a5d0-4ded-b598-05af4f52e88a taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.255157] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-666354e9-a5d0-4ded-b598-05af4f52e88a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.255343] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-666354e9-a5d0-4ded-b598-05af4f52e88a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.255654] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-666354e9-a5d0-4ded-b598-05af4f52e88a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.256031] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('666354e9-a5d0-4ded-b598-05af4f52e88a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.654803] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57e97084-a75e-460b-85c9-345b90077d12',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.655870] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 23ebaebc-c011-427f-bfad-e81c11e9720c with status ACTIVE [ 1147.656095] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.656223] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.656290] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.656512] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.656572] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.656757] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.656855] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.656917] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.657249] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.657331] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.657552] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.657620] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.657676] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.657816] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.657890] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.657986] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 23ebaebc-c011-427f-bfad-e81c11e9720c is going to be updated. [ 1147.659109] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-57e97084-a75e-460b-85c9-345b90077d12 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.659202] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57e97084-a75e-460b-85c9-345b90077d12" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.688625] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.688625] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.688625] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.688625] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.688625] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.688870] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23ebaebc-c011-427f-bfad-e81c11e9720c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.697101] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.697313] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.697361] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.697557] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.697656] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.697853] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.698066] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.698127] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.698280] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.698354] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.698459] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7122ab9-4313-4173-8869-cf7cd16cccf0 is going to be updated. [ 1147.743562] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.743712] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.743835] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.744048] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.744494] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.753466] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7122ab9-4313-4173-8869-cf7cd16cccf0 in Status: IN_PROGRESS for 2s [ 1147.758986] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 666354e9-a5d0-4ded-b598-05af4f52e88a with status ACTIVE [ 1147.761217] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.761217] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.761217] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.761217] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.761217] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.761217] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.761217] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.761217] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.761217] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.761217] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.761217] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.761217] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.761217] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.761217] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.761217] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.761217] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 666354e9-a5d0-4ded-b598-05af4f52e88a is going to be updated. [ 1147.787645] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.787815] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.787885] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.788345] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.788345] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.788607] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-666354e9-a5d0-4ded-b598-05af4f52e88a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.161410] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57e97084-a75e-460b-85c9-345b90077d12',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.663502] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.663789] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.663789] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.663990] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.664092] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.664201] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57e97084-a75e-460b-85c9-345b90077d12 is going to be created. [ 1148.688191] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.688360] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.688404] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.688605] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.688761] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.698973] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57e97084-a75e-460b-85c9-345b90077d12 in Status: UNINITIALIZED for 2s [ 1149.763782] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7122ab9-4313-4173-8869-cf7cd16cccf0 in Status: SUCCESS [ 1149.764077] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7122ab9-4313-4173-8869-cf7cd16cccf0 deletion is rescheduled due to dependency. [ 1149.764179] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7122ab9-4313-4173-8869-cf7cd16cccf0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.815640] env[65471]: INFO networking_nsxv3.common.synchronization [req-941109bc-0427-402c-a03f-e99df3aa8882 req-77a4a92a-9afc-43e6-81dd-ae812ec7e25e tempest-DeleteServersTestJSON-72429361 tempest-DeleteServersTestJSON-72429361-project-member] Enqueued Resource ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 with Priority: HIGHEST for action security_group_members [ 1149.816130] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 with Priority: HIGHEST for action security_group_members [ 1149.816527] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-c35d5123-3fe1-447f-aedc-8112e5faa2b6 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.816678] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.816756] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.817041] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.817233] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.817341] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.817431] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.817619] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.817729] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.817845] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c35d5123-3fe1-447f-aedc-8112e5faa2b6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.177933] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock network-80 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.178326] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "network-80" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.178470] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "network-80" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.178745] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "network-80" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.179039] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.179242] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.179342] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.179491] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.179633] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.179872] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1150.180034] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1150.180166] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1150.180296] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1150.180387] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1150.180491] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1150.180624] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1150.199972] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1150.200216] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1150.200443] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1150.200590] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "network-80" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.200952] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock port-c69cd26a-8b00-41f5-be12-29336106823e taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.201486] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "port-c69cd26a-8b00-41f5-be12-29336106823e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.201647] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "port-c69cd26a-8b00-41f5-be12-29336106823e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.201968] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "port-c69cd26a-8b00-41f5-be12-29336106823e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.202125] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c69cd26a-8b00-41f5-be12-29336106823e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.322497] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.322497] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.322497] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.322497] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.322497] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.322497] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.322497] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.322497] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.322497] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.322497] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.322497] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 is going to be updated. [ 1150.348694] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.348694] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.348694] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.348694] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.348694] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.356881] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 in Status: IN_PROGRESS for 2s [ 1150.704678] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.705349] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.706232] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.706538] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.706685] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.706848] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Segment Port c69cd26a-8b00-41f5-be12-29336106823e not found, creating... [ 1150.707148] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.707313] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.707427] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.707665] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.707796] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.708103] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.708258] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.708371] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.708576] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.708712] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.708850] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Resource: SegmentPort with ID: c69cd26a-8b00-41f5-be12-29336106823e is going to be created. [ 1150.724498] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57e97084-a75e-460b-85c9-345b90077d12 in Status: SUCCESS [ 1150.724720] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57e97084-a75e-460b-85c9-345b90077d12" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.724892] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57e97084-a75e-460b-85c9-345b90077d12" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.725132] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57e97084-a75e-460b-85c9-345b90077d12" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.725329] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.725461] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.725532] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.725688] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.725806] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.725841] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57e97084-a75e-460b-85c9-345b90077d12" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.725933] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('57e97084-a75e-460b-85c9-345b90077d12',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.729723] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.729875] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.730034] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.730275] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.730501] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.730717] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "port-c69cd26a-8b00-41f5-be12-29336106823e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.229279] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-57e97084-a75e-460b-85c9-345b90077d12 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.229808] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57e97084-a75e-460b-85c9-345b90077d12" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.229808] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57e97084-a75e-460b-85c9-345b90077d12" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.230228] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57e97084-a75e-460b-85c9-345b90077d12" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.230228] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.230228] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.230228] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.230609] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.230609] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.230609] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57e97084-a75e-460b-85c9-345b90077d12" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.230609] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-57e97084-a75e-460b-85c9-345b90077d12 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.230768] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57e97084-a75e-460b-85c9-345b90077d12" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.230768] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57e97084-a75e-460b-85c9-345b90077d12" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.230914] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57e97084-a75e-460b-85c9-345b90077d12" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.231034] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.231197] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.231197] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.232244] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.232244] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.232244] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57e97084-a75e-460b-85c9-345b90077d12" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.232244] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('57e97084-a75e-460b-85c9-345b90077d12',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.490924] env[65471]: INFO networking_nsxv3.common.synchronization [req-941109bc-0427-402c-a03f-e99df3aa8882 req-13547668-319e-49cb-af1a-f603a7c6c756 service nova] Enqueued Resource ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 with Priority: HIGHEST for action security_group_rules [ 1151.491165] env[65471]: INFO networking_nsxv3.common.synchronization [req-941109bc-0427-402c-a03f-e99df3aa8882 req-13547668-319e-49cb-af1a-f603a7c6c756 service nova] Enqueued Resource ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 with Priority: HIGHEST for action security_group_members [ 1151.491315] env[65471]: INFO networking_nsxv3.common.synchronization [req-941109bc-0427-402c-a03f-e99df3aa8882 req-13547668-319e-49cb-af1a-f603a7c6c756 service nova] Enqueued Resource ID: c69cd26a-8b00-41f5-be12-29336106823e with Priority: HIGHEST for action port [ 1151.491848] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 with Priority: HIGHEST for action security_group_rules [ 1151.492258] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 with Priority: HIGHEST for action security_group_members [ 1151.492503] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c69cd26a-8b00-41f5-be12-29336106823e with Priority: HIGHEST for action port [ 1151.492820] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c35d5123-3fe1-447f-aedc-8112e5faa2b6 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.492946] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.493014] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.493210] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.493339] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c35d5123-3fe1-447f-aedc-8112e5faa2b6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.494171] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-c35d5123-3fe1-447f-aedc-8112e5faa2b6 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.494296] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.494534] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-c69cd26a-8b00-41f5-be12-29336106823e taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.494668] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c69cd26a-8b00-41f5-be12-29336106823e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.494710] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c69cd26a-8b00-41f5-be12-29336106823e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.494861] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c69cd26a-8b00-41f5-be12-29336106823e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.494936] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c69cd26a-8b00-41f5-be12-29336106823e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.734251] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 57e97084-a75e-460b-85c9-345b90077d12: rpc.has_security_group_logging(os_id): False [ 1151.758216] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.758423] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.758423] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.758652] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.758746] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.758987] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.759115] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.759158] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.759310] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.759387] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.759567] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.759686] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.759792] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.760043] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.760082] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.760253] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.760345] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.760408] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.760545] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.760618] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.760703] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57e97084-a75e-460b-85c9-345b90077d12 is going to be created. [ 1151.828501] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.828657] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.828729] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.828971] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.829185] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.840907] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57e97084-a75e-460b-85c9-345b90077d12 in Status: IN_PROGRESS for 2s [ 1152.000422] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-c35d5123-3fe1-447f-aedc-8112e5faa2b6 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.000564] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.000780] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c69cd26a-8b00-41f5-be12-29336106823e with status ACTIVE [ 1152.000948] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.001070] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.001142] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.001745] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.001745] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.002579] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.002865] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.003053] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.003260] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.003412] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.003676] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.003845] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.003946] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.004201] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.004281] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.004407] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c69cd26a-8b00-41f5-be12-29336106823e is going to be updated. [ 1152.027455] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.027601] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.027639] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.027853] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.027986] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.028161] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c69cd26a-8b00-41f5-be12-29336106823e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.128253] env[65471]: INFO networking_nsxv3.common.synchronization [req-77ab9862-046b-4ad5-85d7-07734dc52c98 req-a1d9d2bd-5d87-475f-b682-4f99ec715110 tempest-ServerActionsTestOtherB-402089456 tempest-ServerActionsTestOtherB-402089456-project-member] Enqueued Resource ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 with Priority: HIGHEST for action security_group_members [ 1152.128253] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 with Priority: HIGHEST for action security_group_members [ 1152.128253] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-b71ce0e0-83fe-4f36-8617-e29f83b0be32 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.132498] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.132498] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.132498] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.132498] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.134420] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.134420] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.134420] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.134420] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.134420] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b71ce0e0-83fe-4f36-8617-e29f83b0be32',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.368913] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 in Status: SUCCESS [ 1152.369467] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 deletion is rescheduled due to dependency. [ 1152.369467] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.369762] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.369985] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.370235] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.370378] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.370493] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.370679] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.370809] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.370961] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c35d5123-3fe1-447f-aedc-8112e5faa2b6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.567304] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock network-852 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.567553] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "network-852" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.567721] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "network-852" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.568108] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "network-852" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.568472] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.568672] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.568843] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.569223] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.569413] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.569652] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1152.569795] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1152.569926] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1152.570092] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1152.570238] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1152.570377] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1152.570579] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1152.606325] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1152.606611] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1152.606793] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1152.606865] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "network-852" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.607183] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock port-86722419-f128-4418-822d-b0ca677c4cc8 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.607358] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "port-86722419-f128-4418-822d-b0ca677c4cc8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.607475] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "port-86722419-f128-4418-822d-b0ca677c4cc8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.607853] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "port-86722419-f128-4418-822d-b0ca677c4cc8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.608044] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86722419-f128-4418-822d-b0ca677c4cc8',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.637927] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.638148] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.638204] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.638410] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.638517] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.638738] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.638844] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.638924] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.639141] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.639218] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.639328] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 is going to be updated. [ 1152.671677] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.671913] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.671913] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.672168] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.672354] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.684724] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 in Status: IN_PROGRESS for 2s [ 1152.874414] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c35d5123-3fe1-447f-aedc-8112e5faa2b6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.926078] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock network-238 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.926692] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "network-238" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.926692] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "network-238" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.926692] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "network-238" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.926922] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.927102] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.927196] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.927405] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.927549] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.927759] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1152.927870] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1152.927974] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1152.928182] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1152.928299] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1152.928404] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1152.928532] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1153.016021] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1153.016201] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Cache value generated in 0.088 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1153.016337] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1153.016515] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "network-238" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.016853] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock port-7b1b7f29-3007-4180-8a5a-865009336243 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.017070] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "port-7b1b7f29-3007-4180-8a5a-865009336243" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.017192] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "port-7b1b7f29-3007-4180-8a5a-865009336243" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.017474] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "port-7b1b7f29-3007-4180-8a5a-865009336243" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.017596] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b1b7f29-3007-4180-8a5a-865009336243',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.110627] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.110885] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.111072] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.111365] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.111564] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.111722] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Segment Port 86722419-f128-4418-822d-b0ca677c4cc8 not found, creating... [ 1153.111995] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.112187] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.112304] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.112568] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.112708] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.112997] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.113159] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.113277] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.113482] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.113608] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.113744] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Resource: SegmentPort with ID: 86722419-f128-4418-822d-b0ca677c4cc8 is going to be created. [ 1153.137505] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.137734] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.137851] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.138166] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.138399] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.138634] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "port-86722419-f128-4418-822d-b0ca677c4cc8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.377632] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c35d5123-3fe1-447f-aedc-8112e5faa2b6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.520165] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.520470] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.520635] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.521026] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.521299] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.522024] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.523315] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.523315] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.523917] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.524207] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.524592] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.524760] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.525461] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.525716] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.525863] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.526542] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Resource: SegmentPort with ID: 7b1b7f29-3007-4180-8a5a-865009336243 is going to be updated. [ 1153.549817] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.550056] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.550229] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.550502] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.550696] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.550911] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "port-7b1b7f29-3007-4180-8a5a-865009336243" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.853293] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57e97084-a75e-460b-85c9-345b90077d12 in Status: SUCCESS [ 1153.853770] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57e97084-a75e-460b-85c9-345b90077d12" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.859267] env[65471]: INFO networking_nsxv3.common.synchronization [req-77ab9862-046b-4ad5-85d7-07734dc52c98 req-39ae5c5e-8132-43a1-92d1-68bb22e38269 service nova] Enqueued Resource ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 with Priority: HIGHEST for action security_group_rules [ 1153.859267] env[65471]: INFO networking_nsxv3.common.synchronization [req-77ab9862-046b-4ad5-85d7-07734dc52c98 req-39ae5c5e-8132-43a1-92d1-68bb22e38269 service nova] Enqueued Resource ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 with Priority: HIGHEST for action security_group_members [ 1153.859267] env[65471]: INFO networking_nsxv3.common.synchronization [req-77ab9862-046b-4ad5-85d7-07734dc52c98 req-39ae5c5e-8132-43a1-92d1-68bb22e38269 service nova] Enqueued Resource ID: 86722419-f128-4418-822d-b0ca677c4cc8 with Priority: HIGHEST for action port [ 1153.859267] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 with Priority: HIGHEST for action security_group_rules [ 1153.859267] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 with Priority: HIGHEST for action security_group_members [ 1153.859267] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86722419-f128-4418-822d-b0ca677c4cc8 with Priority: HIGHEST for action port [ 1153.859267] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b71ce0e0-83fe-4f36-8617-e29f83b0be32 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.859267] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.859664] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.859965] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.860168] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b71ce0e0-83fe-4f36-8617-e29f83b0be32',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.861315] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-b71ce0e0-83fe-4f36-8617-e29f83b0be32 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.861538] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.861897] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-86722419-f128-4418-822d-b0ca677c4cc8 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.862138] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-86722419-f128-4418-822d-b0ca677c4cc8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.862303] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-86722419-f128-4418-822d-b0ca677c4cc8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.862689] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-86722419-f128-4418-822d-b0ca677c4cc8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.862859] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86722419-f128-4418-822d-b0ca677c4cc8',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.881161] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.881161] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.881161] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.881161] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.881161] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.881516] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 is going to be updated. [ 1153.916316] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.916979] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.916979] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.916979] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.916979] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.927540] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 in Status: IN_PROGRESS for 2s [ 1154.182034] env[65471]: INFO networking_nsxv3.common.synchronization [req-48af2a9b-a0e4-48b6-8dfd-3eb307967470 req-e8d9d118-1b8d-40b1-a143-99ce8439161e service nova] Enqueued Resource ID: e8869e0a-9385-48b2-ac90-589c8415df21 with Priority: HIGHEST for action security_group_rules [ 1154.182034] env[65471]: INFO networking_nsxv3.common.synchronization [req-48af2a9b-a0e4-48b6-8dfd-3eb307967470 req-e8d9d118-1b8d-40b1-a143-99ce8439161e service nova] Enqueued Resource ID: e8869e0a-9385-48b2-ac90-589c8415df21 with Priority: HIGHEST for action security_group_members [ 1154.182034] env[65471]: INFO networking_nsxv3.common.synchronization [req-48af2a9b-a0e4-48b6-8dfd-3eb307967470 req-e8d9d118-1b8d-40b1-a143-99ce8439161e service nova] Enqueued Resource ID: 7b1b7f29-3007-4180-8a5a-865009336243 with Priority: HIGHEST for action port [ 1154.182034] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8869e0a-9385-48b2-ac90-589c8415df21 with Priority: HIGHEST for action security_group_rules [ 1154.182034] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8869e0a-9385-48b2-ac90-589c8415df21 with Priority: HIGHEST for action security_group_members [ 1154.182034] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b1b7f29-3007-4180-8a5a-865009336243 with Priority: HIGHEST for action port [ 1154.182034] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e8869e0a-9385-48b2-ac90-589c8415df21 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.182034] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.182568] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.182984] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.183176] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e8869e0a-9385-48b2-ac90-589c8415df21',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.184462] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8869e0a-9385-48b2-ac90-589c8415df21 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.184879] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.185055] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.185362] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.185799] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.185998] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.186157] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.186377] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.186550] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.186784] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e8869e0a-9385-48b2-ac90-589c8415df21',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.188119] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-7b1b7f29-3007-4180-8a5a-865009336243 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.188374] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7b1b7f29-3007-4180-8a5a-865009336243" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.188621] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7b1b7f29-3007-4180-8a5a-865009336243" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.188864] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7b1b7f29-3007-4180-8a5a-865009336243" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.189083] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b1b7f29-3007-4180-8a5a-865009336243',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.364725] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-b71ce0e0-83fe-4f36-8617-e29f83b0be32 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.364863] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.365218] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 86722419-f128-4418-822d-b0ca677c4cc8 with status ACTIVE [ 1154.365420] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.365544] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.365628] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.365821] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.365908] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.366093] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.366172] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.366229] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.366369] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.366436] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.366610] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.366696] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.366747] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.366920] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.366990] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.367140] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 86722419-f128-4418-822d-b0ca677c4cc8 is going to be updated. [ 1154.394146] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.394146] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.394146] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.394146] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.394146] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.394146] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-86722419-f128-4418-822d-b0ca677c4cc8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.691660] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8869e0a-9385-48b2-ac90-589c8415df21 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.691910] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.692264] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e8869e0a-9385-48b2-ac90-589c8415df21',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.693574] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7b1b7f29-3007-4180-8a5a-865009336243 with status ACTIVE [ 1154.695388] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.695388] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.695388] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.695596] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.695626] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.695842] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.695954] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.696032] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.696236] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.696532] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.696631] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.696806] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.696912] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.697155] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.697289] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.697448] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7b1b7f29-3007-4180-8a5a-865009336243 is going to be updated. [ 1154.699668] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 in Status: SUCCESS [ 1154.699821] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 deletion is rescheduled due to dependency. [ 1154.700088] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.701128] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.701128] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.701128] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.701128] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.701128] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.701128] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.701128] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.701799] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b71ce0e0-83fe-4f36-8617-e29f83b0be32',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.737226] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.737546] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.737546] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.737852] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.738224] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.738699] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7b1b7f29-3007-4180-8a5a-865009336243" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.199998] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e8869e0a-9385-48b2-ac90-589c8415df21',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.204334] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b71ce0e0-83fe-4f36-8617-e29f83b0be32',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.706021] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.706021] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.706021] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.706021] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.706021] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.706021] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8869e0a-9385-48b2-ac90-589c8415df21 is going to be updated. [ 1155.709678] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b71ce0e0-83fe-4f36-8617-e29f83b0be32',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.736602] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.736784] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.736859] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.738052] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.738052] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.747981] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8869e0a-9385-48b2-ac90-589c8415df21 in Status: IN_PROGRESS for 2s [ 1155.938066] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 in Status: SUCCESS [ 1155.938319] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.938485] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.938716] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.938908] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.939035] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.939100] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.939254] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.939337] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.939421] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.939514] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c35d5123-3fe1-447f-aedc-8112e5faa2b6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.212244] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.212499] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.212643] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.212953] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.213114] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.213293] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 is going to be updated. [ 1156.245949] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.246121] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.246248] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.246415] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.246586] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.255094] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 in Status: IN_PROGRESS for 2s [ 1156.441748] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-c35d5123-3fe1-447f-aedc-8112e5faa2b6 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.441989] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.442070] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.442285] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.442486] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.442689] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.442689] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.442811] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.442900] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.442987] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.443176] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-c35d5123-3fe1-447f-aedc-8112e5faa2b6 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.443278] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.443346] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.443491] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.443644] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.443746] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.443809] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.443957] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.444058] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.444114] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.444219] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c35d5123-3fe1-447f-aedc-8112e5faa2b6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.946421] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c35d5123-3fe1-447f-aedc-8112e5faa2b6: rpc.has_security_group_logging(os_id): False [ 1156.964929] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.965150] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.965150] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.965308] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.965399] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.965646] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.965767] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.965804] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.965944] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.966035] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.966244] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.966338] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.966400] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.966539] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.966614] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.966999] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.967117] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.967179] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.967322] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.967398] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.967483] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 is going to be updated. [ 1157.030464] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.030744] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.030744] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.031570] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.031570] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.049048] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 in Status: IN_PROGRESS for 2s [ 1157.296912] env[65471]: INFO networking_nsxv3.common.synchronization [req-ccd86e67-4d46-438d-af4d-e63b9fb186b3 req-51604178-cd25-499b-b9ab-66ab9a7697f9 tempest-ServersTestJSON-569130442 tempest-ServersTestJSON-569130442-project-member] Enqueued Resource ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 with Priority: HIGHEST for action security_group_members [ 1157.297412] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 with Priority: HIGHEST for action security_group_members [ 1157.297737] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-735019a1-4315-46a6-b3c7-ec71fdc6ef33 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.297854] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.297921] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.298146] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.298321] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.298386] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.298455] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.298613] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.298707] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.298800] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.660147] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock network-92 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.660367] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "network-92" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.660486] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "network-92" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.660748] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "network-92" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.661079] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.661243] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.661356] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.661586] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.661723] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.661939] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1157.662068] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1157.662175] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1157.662279] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1157.662383] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1157.662512] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1157.662660] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1157.683549] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1157.683760] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1157.683905] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1157.684113] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "network-92" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.684512] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock port-773be9ad-282f-4032-a270-e543c995e1e2 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.684716] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "port-773be9ad-282f-4032-a270-e543c995e1e2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.684867] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "port-773be9ad-282f-4032-a270-e543c995e1e2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.685310] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "port-773be9ad-282f-4032-a270-e543c995e1e2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.685540] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('773be9ad-282f-4032-a270-e543c995e1e2',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.758332] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8869e0a-9385-48b2-ac90-589c8415df21 in Status: SUCCESS [ 1157.758687] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.758952] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.759301] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.759515] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.759637] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.759707] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.759867] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.759943] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.760040] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.760132] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e8869e0a-9385-48b2-ac90-589c8415df21',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.801307] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.188344] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.188768] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.188806] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.189083] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.189236] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.189389] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Segment Port 773be9ad-282f-4032-a270-e543c995e1e2 not found, creating... [ 1158.189726] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.189930] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.190079] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.190347] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.190545] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.190919] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.191131] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.191364] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.191630] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.191810] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.191989] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Resource: SegmentPort with ID: 773be9ad-282f-4032-a270-e543c995e1e2 is going to be created. [ 1158.215158] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.215419] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.215641] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.215989] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.216263] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.216647] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "port-773be9ad-282f-4032-a270-e543c995e1e2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.262248] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8869e0a-9385-48b2-ac90-589c8415df21 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.262530] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.262530] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.262677] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.262854] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.262961] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.263035] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.263208] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.263320] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.263478] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.263708] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8869e0a-9385-48b2-ac90-589c8415df21 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.263859] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.263955] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.264233] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.264379] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.264541] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.264609] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.264807] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.264920] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.265054] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.265258] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e8869e0a-9385-48b2-ac90-589c8415df21',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.268845] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 in Status: SUCCESS [ 1158.269181] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.269383] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.269662] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.269942] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.270128] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.270248] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.270465] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.270582] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.270716] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.270858] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b71ce0e0-83fe-4f36-8617-e29f83b0be32',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.303101] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.767651] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e8869e0a-9385-48b2-ac90-589c8415df21: rpc.has_security_group_logging(os_id): False [ 1158.773655] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b71ce0e0-83fe-4f36-8617-e29f83b0be32',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.787155] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.787390] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.787504] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.787840] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.787954] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.788205] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.788317] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.788390] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.788561] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.788648] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.788885] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.788977] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.789060] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.789204] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.789274] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.789460] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.789544] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.789600] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.789733] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.789805] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.789888] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e8869e0a-9385-48b2-ac90-589c8415df21 is going to be updated. [ 1158.805865] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.806104] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.806284] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.806472] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.806624] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.806744] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 is going to be updated. [ 1158.836021] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.836253] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.836341] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.836561] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.836746] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.847968] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 in Status: IN_PROGRESS for 2s [ 1158.868337] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.868542] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.868542] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.868757] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.868897] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.893399] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e8869e0a-9385-48b2-ac90-589c8415df21 in Status: IN_PROGRESS for 2s [ 1158.983843] env[65471]: INFO networking_nsxv3.common.synchronization [req-ccd86e67-4d46-438d-af4d-e63b9fb186b3 req-ab5c3d1f-6b98-443c-9890-92098d73c78c service nova] Enqueued Resource ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 with Priority: HIGHEST for action security_group_rules [ 1158.983843] env[65471]: INFO networking_nsxv3.common.synchronization [req-ccd86e67-4d46-438d-af4d-e63b9fb186b3 req-ab5c3d1f-6b98-443c-9890-92098d73c78c service nova] Enqueued Resource ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 with Priority: HIGHEST for action security_group_members [ 1158.983843] env[65471]: INFO networking_nsxv3.common.synchronization [req-ccd86e67-4d46-438d-af4d-e63b9fb186b3 req-ab5c3d1f-6b98-443c-9890-92098d73c78c service nova] Enqueued Resource ID: 773be9ad-282f-4032-a270-e543c995e1e2 with Priority: HIGHEST for action port [ 1158.984348] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 with Priority: HIGHEST for action security_group_rules [ 1158.984560] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 with Priority: HIGHEST for action security_group_members [ 1158.984717] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 773be9ad-282f-4032-a270-e543c995e1e2 with Priority: HIGHEST for action port [ 1158.985188] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-735019a1-4315-46a6-b3c7-ec71fdc6ef33 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.985372] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.985474] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.987117] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.987117] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.987339] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-735019a1-4315-46a6-b3c7-ec71fdc6ef33 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.987395] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.987732] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-773be9ad-282f-4032-a270-e543c995e1e2 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.987893] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-773be9ad-282f-4032-a270-e543c995e1e2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.987953] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-773be9ad-282f-4032-a270-e543c995e1e2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.988622] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-773be9ad-282f-4032-a270-e543c995e1e2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.988622] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('773be9ad-282f-4032-a270-e543c995e1e2',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.076394] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 in Status: SUCCESS [ 1159.076650] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.275910] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b71ce0e0-83fe-4f36-8617-e29f83b0be32: rpc.has_security_group_logging(os_id): False [ 1159.307654] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.307860] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.307860] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.308044] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.308167] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.308414] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.308520] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.308582] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.308747] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.308817] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.308907] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 is going to be updated. [ 1159.379940] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.380205] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.380205] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.380391] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.380536] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.396420] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 in Status: IN_PROGRESS for 2s [ 1159.490805] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-735019a1-4315-46a6-b3c7-ec71fdc6ef33 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.490999] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.491215] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 773be9ad-282f-4032-a270-e543c995e1e2 with status ACTIVE [ 1159.491378] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.491536] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.491637] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.491936] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.492120] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.492371] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.492518] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.492628] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.492860] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.492992] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.493273] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.493415] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.493513] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.493741] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.493861] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.493989] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 773be9ad-282f-4032-a270-e543c995e1e2 is going to be updated. [ 1159.518709] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.518709] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.518975] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.518975] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.519114] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.519279] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-773be9ad-282f-4032-a270-e543c995e1e2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.859491] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 in Status: SUCCESS [ 1160.860103] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.860103] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.860234] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.860492] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.860640] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.860710] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.860885] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.860968] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.861077] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.911046] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e8869e0a-9385-48b2-ac90-589c8415df21 in Status: SUCCESS [ 1160.911317] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.363394] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.411986] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 in Status: SUCCESS [ 1161.412237] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.866594] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.369484] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.369742] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.369889] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.370250] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.370425] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.370602] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 is going to be updated. [ 1162.408118] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.408330] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.408378] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.408592] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.408743] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.421064] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 in Status: IN_PROGRESS for 2s [ 1163.086309] env[65471]: INFO networking_nsxv3.common.synchronization [req-6985705e-1303-4e08-905d-89df71e36d48 req-a6f8eb8a-3760-4339-9645-c25a63cc6f1e tempest-AttachInterfacesV270Test-1055750875 tempest-AttachInterfacesV270Test-1055750875-project-member] Enqueued Resource ID: 57e97084-a75e-460b-85c9-345b90077d12 with Priority: HIGHEST for action security_group_members [ 1163.087272] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57e97084-a75e-460b-85c9-345b90077d12 with Priority: HIGHEST for action security_group_members [ 1163.087610] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-57e97084-a75e-460b-85c9-345b90077d12 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.088067] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57e97084-a75e-460b-85c9-345b90077d12" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.088156] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57e97084-a75e-460b-85c9-345b90077d12" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.088356] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57e97084-a75e-460b-85c9-345b90077d12" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.088520] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.088616] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.088665] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.088821] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.088914] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.088985] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57e97084-a75e-460b-85c9-345b90077d12',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.600622] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.600838] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.601020] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.601277] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.601382] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.601629] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.601936] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.602086] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.602292] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.602382] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.602530] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57e97084-a75e-460b-85c9-345b90077d12 is going to be updated. [ 1163.632784] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.633075] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.633075] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.633204] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.633345] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.642340] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57e97084-a75e-460b-85c9-345b90077d12 in Status: IN_PROGRESS for 2s [ 1164.434887] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 in Status: SUCCESS [ 1164.435389] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.435484] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.435803] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.436102] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.436303] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.436416] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.436661] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.436788] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.436927] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.437092] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.687053] env[65471]: INFO networking_nsxv3.common.synchronization [req-d4593e93-56eb-43fe-a0a7-11180f054a4b req-25ba164e-2223-48a0-9a77-10431097338c tempest-DeleteServersTestJSON-72429361 tempest-DeleteServersTestJSON-72429361-project-member] Enqueued Resource ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 with Priority: HIGHEST for action security_group_members [ 1164.687650] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 with Priority: HIGHEST for action security_group_members [ 1164.688866] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-c35d5123-3fe1-447f-aedc-8112e5faa2b6 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.689069] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.689140] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.689348] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.689529] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.689638] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.689717] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.689798] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.689871] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.689975] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c35d5123-3fe1-447f-aedc-8112e5faa2b6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.939566] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-735019a1-4315-46a6-b3c7-ec71fdc6ef33 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.939830] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.939830] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.940036] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.940212] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.940308] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.940364] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.940526] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.940612] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.940699] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.940849] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-735019a1-4315-46a6-b3c7-ec71fdc6ef33 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.940932] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.941010] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.941265] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.941409] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.941493] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.941548] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.941690] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.941793] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.941854] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.941962] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.191949] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.192206] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.192281] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.192531] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.192639] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.192854] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.192952] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.193033] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.193201] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.193278] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.193367] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 is going to be updated. [ 1165.222182] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.222436] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.222436] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.222668] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.222853] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.232793] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 in Status: IN_PROGRESS for 2s [ 1165.446430] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 735019a1-4315-46a6-b3c7-ec71fdc6ef33: rpc.has_security_group_logging(os_id): False [ 1165.465413] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.465617] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.465617] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.465933] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.466184] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.466412] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.466517] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.466580] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.466738] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.466818] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.467033] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.467135] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.467188] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.467325] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.467425] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.467614] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.467699] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.467736] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.467860] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.467932] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.468030] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 is going to be updated. [ 1165.533295] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.533515] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.533658] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.533922] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.534127] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.548067] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 in Status: IN_PROGRESS for 2s [ 1165.659606] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57e97084-a75e-460b-85c9-345b90077d12 in Status: SUCCESS [ 1165.659918] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57e97084-a75e-460b-85c9-345b90077d12 deletion is rescheduled due to dependency. [ 1165.660091] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57e97084-a75e-460b-85c9-345b90077d12" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.243645] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 in Status: IN_PROGRESS for 4s [ 1167.564059] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 in Status: SUCCESS [ 1167.564325] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.253710] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 in Status: SUCCESS [ 1169.254027] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 deletion is rescheduled due to dependency. [ 1169.254068] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.688716] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1169.688796] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1171.331541] env[65471]: INFO networking_nsxv3.common.synchronization [req-74f95875-7d0c-4cb3-96a3-773b5ae3ae5f req-169de0bb-f051-4582-af1b-d627f5320e84 tempest-AttachInterfacesTestJSON-1197806586 tempest-AttachInterfacesTestJSON-1197806586-project-member] Enqueued Resource ID: 89cca73a-b121-4b09-8f43-f96b481d6295 with Priority: HIGHEST for action security_group_members [ 1171.332121] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89cca73a-b121-4b09-8f43-f96b481d6295 with Priority: HIGHEST for action security_group_members [ 1171.332437] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-89cca73a-b121-4b09-8f43-f96b481d6295 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.332610] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89cca73a-b121-4b09-8f43-f96b481d6295" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.332714] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89cca73a-b121-4b09-8f43-f96b481d6295" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.333144] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89cca73a-b121-4b09-8f43-f96b481d6295" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.333240] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.333396] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.333517] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.333698] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.333824] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.333882] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('89cca73a-b121-4b09-8f43-f96b481d6295',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.837438] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('89cca73a-b121-4b09-8f43-f96b481d6295',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.137908] env[65471]: INFO networking_nsxv3.common.synchronization [req-a76932df-68e6-47cc-a5e6-505f8745d31e req-3b1fcc66-3334-4887-8a22-d86ac5e4b5cd tempest-ServersTestJSON-569130442 tempest-ServersTestJSON-569130442-project-member] Enqueued Resource ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 with Priority: HIGHEST for action security_group_members [ 1172.138458] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 with Priority: HIGHEST for action security_group_members [ 1172.138780] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-735019a1-4315-46a6-b3c7-ec71fdc6ef33 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.138903] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.138973] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.139543] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.139709] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.139814] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.139881] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.140041] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.140126] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.140220] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.341071] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('89cca73a-b121-4b09-8f43-f96b481d6295',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.370749] env[65471]: INFO networking_nsxv3.common.synchronization [req-0337d083-645d-4da9-bddb-2da610965592 req-8b70b17b-4b64-481e-ae80-75c0390010b5 tempest-ServerActionsTestOtherA-1623203122 tempest-ServerActionsTestOtherA-1623203122-project-member] Enqueued Resource ID: f7dafcbc-15be-4704-ad92-28657ead70aa with Priority: HIGHEST for action security_group_members [ 1172.370749] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7dafcbc-15be-4704-ad92-28657ead70aa with Priority: HIGHEST for action security_group_members [ 1172.370749] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7dafcbc-15be-4704-ad92-28657ead70aa taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.372318] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.373254] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.373254] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.373254] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.373747] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.373937] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.374236] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.374450] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.374734] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7dafcbc-15be-4704-ad92-28657ead70aa',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.641987] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.703144] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock network-344 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.703486] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "network-344" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.703486] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "network-344" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.703725] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "network-344" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.705334] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.705334] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.705334] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.705334] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.705334] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.705334] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1172.705334] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1172.705334] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1172.705334] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1172.705334] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1172.705793] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1172.705793] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1172.727736] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1172.727968] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1172.728144] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1172.728309] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "network-344" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.728631] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock port-8a27ed38-ddf7-42c2-b697-dfd7b1cc6f92 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.728817] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "port-8a27ed38-ddf7-42c2-b697-dfd7b1cc6f92" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.728968] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "port-8a27ed38-ddf7-42c2-b697-dfd7b1cc6f92" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.729283] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "port-8a27ed38-ddf7-42c2-b697-dfd7b1cc6f92" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.729420] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a27ed38-ddf7-42c2-b697-dfd7b1cc6f92',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.843321] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.843495] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.843495] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.843751] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.843855] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.843960] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 89cca73a-b121-4b09-8f43-f96b481d6295 is going to be updated. [ 1172.877150] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.877338] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.877338] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.877527] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.877633] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.878774] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f7dafcbc-15be-4704-ad92-28657ead70aa',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.887986] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89cca73a-b121-4b09-8f43-f96b481d6295 in Status: IN_PROGRESS for 2s [ 1173.145689] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.232715] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.233027] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.233208] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.233535] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.233738] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.233927] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Segment Port 8a27ed38-ddf7-42c2-b697-dfd7b1cc6f92 not found, creating... [ 1173.234282] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.234460] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.234629] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.234924] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.235118] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.235481] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.235720] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.235862] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.236094] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.236239] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.236389] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Resource: SegmentPort with ID: 8a27ed38-ddf7-42c2-b697-dfd7b1cc6f92 is going to be created. [ 1173.259830] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.260159] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.260292] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.260599] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.260827] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.261079] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "port-8a27ed38-ddf7-42c2-b697-dfd7b1cc6f92" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.382431] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f7dafcbc-15be-4704-ad92-28657ead70aa',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.647783] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.647945] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.648026] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.648244] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.648333] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.648435] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 is going to be updated. [ 1173.676319] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.676319] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.676567] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.676605] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.676736] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.688037] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 in Status: IN_PROGRESS for 2s [ 1173.884955] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.885129] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.885177] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.885604] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.885604] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.885604] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7dafcbc-15be-4704-ad92-28657ead70aa is going to be updated. [ 1173.916971] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.917136] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.917242] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.917475] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.917717] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.927046] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7dafcbc-15be-4704-ad92-28657ead70aa in Status: IN_PROGRESS for 2s [ 1173.976953] env[65471]: INFO networking_nsxv3.common.synchronization [req-0337d083-645d-4da9-bddb-2da610965592 req-3641744e-f8a7-436c-ba53-51c54d79a2a4 service nova] Enqueued Resource ID: f7dafcbc-15be-4704-ad92-28657ead70aa with Priority: HIGHEST for action security_group_rules [ 1173.977568] env[65471]: INFO networking_nsxv3.common.synchronization [req-0337d083-645d-4da9-bddb-2da610965592 req-3641744e-f8a7-436c-ba53-51c54d79a2a4 service nova] Enqueued Resource ID: f7dafcbc-15be-4704-ad92-28657ead70aa with Priority: HIGHEST for action security_group_members [ 1173.977568] env[65471]: INFO networking_nsxv3.common.synchronization [req-0337d083-645d-4da9-bddb-2da610965592 req-3641744e-f8a7-436c-ba53-51c54d79a2a4 service nova] Enqueued Resource ID: 8a27ed38-ddf7-42c2-b697-dfd7b1cc6f92 with Priority: HIGHEST for action port [ 1173.977568] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7dafcbc-15be-4704-ad92-28657ead70aa with Priority: HIGHEST for action security_group_rules [ 1173.977853] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7dafcbc-15be-4704-ad92-28657ead70aa with Priority: HIGHEST for action security_group_members [ 1173.977853] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a27ed38-ddf7-42c2-b697-dfd7b1cc6f92 with Priority: HIGHEST for action port [ 1173.978268] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7dafcbc-15be-4704-ad92-28657ead70aa taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.978749] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.978791] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.979012] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.979092] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7dafcbc-15be-4704-ad92-28657ead70aa',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.979910] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7dafcbc-15be-4704-ad92-28657ead70aa taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.980270] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.980270] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-8a27ed38-ddf7-42c2-b697-dfd7b1cc6f92 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.980397] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8a27ed38-ddf7-42c2-b697-dfd7b1cc6f92" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.980397] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8a27ed38-ddf7-42c2-b697-dfd7b1cc6f92" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.980509] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8a27ed38-ddf7-42c2-b697-dfd7b1cc6f92" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.980585] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a27ed38-ddf7-42c2-b697-dfd7b1cc6f92',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.484650] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7dafcbc-15be-4704-ad92-28657ead70aa taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.484991] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.485131] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8a27ed38-ddf7-42c2-b697-dfd7b1cc6f92 with status ACTIVE [ 1174.485220] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.485335] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.485387] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.485650] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.485749] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.485959] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.486070] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.486129] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.486283] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.486366] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.486547] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.486638] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.486699] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.486866] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.486953] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.487058] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8a27ed38-ddf7-42c2-b697-dfd7b1cc6f92 is going to be updated. [ 1174.509831] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.510035] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.510035] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.510256] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.510396] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.510555] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8a27ed38-ddf7-42c2-b697-dfd7b1cc6f92" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.626141] env[65471]: INFO networking_nsxv3.common.synchronization [req-414f19e8-fc2a-4821-bcca-9a38e31b93c2 req-59372b8f-78a1-4750-9a18-061ce2334a87 tempest-DeleteServersTestJSON-72429361 tempest-DeleteServersTestJSON-72429361-project-member] Enqueued Resource ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 with Priority: HIGHEST for action security_group_members [ 1174.626662] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 with Priority: HIGHEST for action security_group_members [ 1174.626974] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-c35d5123-3fe1-447f-aedc-8112e5faa2b6 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.627118] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.627176] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.627392] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.627562] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.627665] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.627729] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.628078] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.628078] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.628078] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c35d5123-3fe1-447f-aedc-8112e5faa2b6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.899574] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89cca73a-b121-4b09-8f43-f96b481d6295 in Status: SUCCESS [ 1174.899950] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89cca73a-b121-4b09-8f43-f96b481d6295" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.969201] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock network-80 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.969402] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "network-80" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.969524] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "network-80" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.969889] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "network-80" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.970361] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.970515] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.970631] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.970860] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.971016] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.971236] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1174.971349] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1174.971454] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1174.971560] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1174.971691] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1174.971784] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1174.971912] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1174.997648] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1174.997925] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1174.998079] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1174.998262] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "network-80" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.998579] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock port-5b39011f-9dc2-4711-85d2-35f8726f627d taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.998752] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "port-5b39011f-9dc2-4711-85d2-35f8726f627d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.998871] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "port-5b39011f-9dc2-4711-85d2-35f8726f627d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.999233] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "port-5b39011f-9dc2-4711-85d2-35f8726f627d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.999394] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b39011f-9dc2-4711-85d2-35f8726f627d',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.130041] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.130214] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.130290] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.130513] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.130691] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.130906] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.131019] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.131083] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.131245] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.131324] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.131518] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 is going to be updated. [ 1175.158868] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.159087] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.159087] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.159376] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.159529] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.168507] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 in Status: IN_PROGRESS for 2s [ 1175.501975] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.502281] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.502349] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.502632] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.502785] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.502940] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Segment Port 5b39011f-9dc2-4711-85d2-35f8726f627d not found, creating... [ 1175.503223] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.503380] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.503496] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.503713] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.503850] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.504143] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.504294] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.504408] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.504610] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.504800] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.504953] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Resource: SegmentPort with ID: 5b39011f-9dc2-4711-85d2-35f8726f627d is going to be created. [ 1175.526056] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.526329] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.526452] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.526717] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.526941] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.527212] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "port-5b39011f-9dc2-4711-85d2-35f8726f627d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.701112] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 in Status: SUCCESS [ 1175.701388] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.938914] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7dafcbc-15be-4704-ad92-28657ead70aa in Status: SUCCESS [ 1175.939196] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.939376] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.939609] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.939807] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.939922] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.939998] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.940160] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.940233] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.940335] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7dafcbc-15be-4704-ad92-28657ead70aa',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.232820] env[65471]: INFO networking_nsxv3.common.synchronization [req-414f19e8-fc2a-4821-bcca-9a38e31b93c2 req-67e64efb-119c-4f90-b267-7dea90b86bc4 service nova] Enqueued Resource ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 with Priority: HIGHEST for action security_group_rules [ 1176.232928] env[65471]: INFO networking_nsxv3.common.synchronization [req-414f19e8-fc2a-4821-bcca-9a38e31b93c2 req-67e64efb-119c-4f90-b267-7dea90b86bc4 service nova] Enqueued Resource ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 with Priority: HIGHEST for action security_group_members [ 1176.233109] env[65471]: INFO networking_nsxv3.common.synchronization [req-414f19e8-fc2a-4821-bcca-9a38e31b93c2 req-67e64efb-119c-4f90-b267-7dea90b86bc4 service nova] Enqueued Resource ID: 5b39011f-9dc2-4711-85d2-35f8726f627d with Priority: HIGHEST for action port [ 1176.233665] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 with Priority: HIGHEST for action security_group_rules [ 1176.233824] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 with Priority: HIGHEST for action security_group_members [ 1176.233927] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b39011f-9dc2-4711-85d2-35f8726f627d with Priority: HIGHEST for action port [ 1176.234478] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c35d5123-3fe1-447f-aedc-8112e5faa2b6 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.234593] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.234662] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.234898] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.234982] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c35d5123-3fe1-447f-aedc-8112e5faa2b6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.236158] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-c35d5123-3fe1-447f-aedc-8112e5faa2b6 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.236308] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.236531] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-5b39011f-9dc2-4711-85d2-35f8726f627d taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.236662] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5b39011f-9dc2-4711-85d2-35f8726f627d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.236731] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5b39011f-9dc2-4711-85d2-35f8726f627d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.236954] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5b39011f-9dc2-4711-85d2-35f8726f627d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.236954] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b39011f-9dc2-4711-85d2-35f8726f627d',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.443151] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f7dafcbc-15be-4704-ad92-28657ead70aa',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.738481] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-c35d5123-3fe1-447f-aedc-8112e5faa2b6 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.738946] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.738946] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5b39011f-9dc2-4711-85d2-35f8726f627d with status ACTIVE [ 1176.739063] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.739210] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.739306] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.739560] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.739683] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.739921] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.740066] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.740156] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.740466] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.740573] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.740835] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.740936] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.741034] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.741181] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.741257] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.741343] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5b39011f-9dc2-4711-85d2-35f8726f627d is going to be updated. [ 1176.772353] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.772554] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.772617] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.772919] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.773127] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.773381] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5b39011f-9dc2-4711-85d2-35f8726f627d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.945404] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f7dafcbc-15be-4704-ad92-28657ead70aa',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.179190] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 in Status: SUCCESS [ 1177.179417] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 deletion is rescheduled due to dependency. [ 1177.179557] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.179754] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.180010] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.180239] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.180377] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.180452] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.180631] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.180744] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.180850] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c35d5123-3fe1-447f-aedc-8112e5faa2b6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.447952] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.448272] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.448272] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.449143] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.449143] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.449143] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7dafcbc-15be-4704-ad92-28657ead70aa is going to be updated. [ 1177.494034] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.494245] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.494374] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.494788] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.494952] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.507746] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7dafcbc-15be-4704-ad92-28657ead70aa in Status: IN_PROGRESS for 2s [ 1177.683940] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c35d5123-3fe1-447f-aedc-8112e5faa2b6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.186162] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c35d5123-3fe1-447f-aedc-8112e5faa2b6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.689960] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.690958] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.691211] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.691482] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.691608] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.691747] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 is going to be updated. [ 1178.722267] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.723138] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.723138] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.723138] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.723138] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.732513] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 in Status: IN_PROGRESS for 2s [ 1178.853529] env[65471]: INFO networking_nsxv3.common.synchronization [req-3b33f774-2ed5-4c77-bd49-6964a9deb1c2 req-b277ccaa-631c-4b08-9eb7-a78876bb522e tempest-AttachInterfacesTestJSON-1197806586 tempest-AttachInterfacesTestJSON-1197806586-project-member] Enqueued Resource ID: 89cca73a-b121-4b09-8f43-f96b481d6295 with Priority: HIGHEST for action security_group_members [ 1178.855957] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89cca73a-b121-4b09-8f43-f96b481d6295 with Priority: HIGHEST for action security_group_members [ 1178.856601] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-89cca73a-b121-4b09-8f43-f96b481d6295 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.856601] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89cca73a-b121-4b09-8f43-f96b481d6295" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.856601] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89cca73a-b121-4b09-8f43-f96b481d6295" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.856779] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89cca73a-b121-4b09-8f43-f96b481d6295" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.856950] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.857590] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.857636] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.857799] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.857908] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.858018] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('89cca73a-b121-4b09-8f43-f96b481d6295',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.359957] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.360255] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.360255] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.360440] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.360530] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.360736] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.360832] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.360893] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.361056] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.361132] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.361216] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 89cca73a-b121-4b09-8f43-f96b481d6295 is going to be updated. [ 1179.387382] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.387639] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.387639] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.387823] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.388000] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.397535] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89cca73a-b121-4b09-8f43-f96b481d6295 in Status: IN_PROGRESS for 2s [ 1179.521186] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7dafcbc-15be-4704-ad92-28657ead70aa in Status: SUCCESS [ 1179.521408] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.521585] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.521803] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.521996] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.522129] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.522194] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.522356] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.522436] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.522523] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.522637] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f7dafcbc-15be-4704-ad92-28657ead70aa',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.025113] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f7dafcbc-15be-4704-ad92-28657ead70aa',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.527506] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f7dafcbc-15be-4704-ad92-28657ead70aa: rpc.has_security_group_logging(os_id): False [ 1180.555326] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.555573] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.555573] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.555793] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.556033] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.556320] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.556436] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.556506] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.556685] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.556762] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.556862] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7dafcbc-15be-4704-ad92-28657ead70aa is going to be updated. [ 1180.621705] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.621941] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.621941] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.622181] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.622336] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.637144] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7dafcbc-15be-4704-ad92-28657ead70aa in Status: IN_PROGRESS for 2s [ 1180.745025] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 in Status: SUCCESS [ 1180.745225] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.745388] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.745708] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.745837] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.745989] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.746072] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.746229] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.746310] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.746393] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.746485] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c35d5123-3fe1-447f-aedc-8112e5faa2b6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.249927] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-c35d5123-3fe1-447f-aedc-8112e5faa2b6 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.249927] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.249927] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.250608] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.250608] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.250608] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.250608] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.250805] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.250856] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.250973] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.251504] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-c35d5123-3fe1-447f-aedc-8112e5faa2b6 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.251504] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.251504] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.251504] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.251694] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.251752] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.251831] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.252014] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.252105] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.252222] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.252323] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c35d5123-3fe1-447f-aedc-8112e5faa2b6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.408544] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89cca73a-b121-4b09-8f43-f96b481d6295 in Status: SUCCESS [ 1181.409192] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 89cca73a-b121-4b09-8f43-f96b481d6295 deletion is rescheduled due to dependency. [ 1181.410201] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89cca73a-b121-4b09-8f43-f96b481d6295" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.755262] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c35d5123-3fe1-447f-aedc-8112e5faa2b6: rpc.has_security_group_logging(os_id): False [ 1181.774590] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.774831] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.774907] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.775139] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.775229] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.775712] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.775712] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.775712] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.775712] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.775978] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.775978] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.776100] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.776147] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.776285] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.776357] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.776489] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.776600] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.776670] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.776751] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.776827] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.776893] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 is going to be updated. [ 1181.840128] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.840534] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.840652] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.841023] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.841106] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.854106] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 in Status: IN_PROGRESS for 2s [ 1182.650362] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7dafcbc-15be-4704-ad92-28657ead70aa in Status: SUCCESS [ 1182.650616] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.856424] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1183.856703] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1183.868812] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 in Status: SUCCESS [ 1183.869059] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.016276] env[65471]: INFO networking_nsxv3.common.synchronization [req-f5a59c4b-0b6c-402d-9db6-b4ff0314cfb3 req-5404660c-3667-4114-a01d-829004e76a2f tempest-ServersTestJSON-569130442 tempest-ServersTestJSON-569130442-project-member] Enqueued Resource ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 with Priority: HIGHEST for action security_group_members [ 1184.016372] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 with Priority: HIGHEST for action security_group_members [ 1184.016658] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-735019a1-4315-46a6-b3c7-ec71fdc6ef33 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.016781] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.016847] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.017057] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.017213] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.017309] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.017381] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.017509] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.017590] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.017692] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.380464] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock network-92 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.380662] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "network-92" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.380788] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "network-92" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.381081] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "network-92" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.381363] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.381514] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.381629] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.381845] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.381992] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.382327] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1184.382457] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1184.382567] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1184.382677] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1184.382829] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1184.382896] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1184.383163] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1184.402261] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1184.402440] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1184.402584] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1184.402758] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "network-92" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.403077] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock port-1546614c-8fc6-4f14-a565-560d26b4242e taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.403251] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "port-1546614c-8fc6-4f14-a565-560d26b4242e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.403372] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "port-1546614c-8fc6-4f14-a565-560d26b4242e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.403693] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "port-1546614c-8fc6-4f14-a565-560d26b4242e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.403833] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1546614c-8fc6-4f14-a565-560d26b4242e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.519562] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.906810] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.907245] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.907245] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.907459] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.907621] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.907770] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Segment Port 1546614c-8fc6-4f14-a565-560d26b4242e not found, creating... [ 1184.908042] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.908204] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.908320] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.908537] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.908681] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.908951] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.909141] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.909257] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.909461] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.909594] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.909744] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Resource: SegmentPort with ID: 1546614c-8fc6-4f14-a565-560d26b4242e is going to be created. [ 1184.930418] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.930418] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.930529] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.930795] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.931060] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.931291] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "port-1546614c-8fc6-4f14-a565-560d26b4242e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.022578] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.525580] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.525790] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.525892] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.526162] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.526272] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.526409] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 is going to be updated. [ 1185.557894] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.557894] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.557894] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.558779] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.558779] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.570110] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 in Status: IN_PROGRESS for 2s [ 1185.633074] env[65471]: INFO networking_nsxv3.common.synchronization [req-f5a59c4b-0b6c-402d-9db6-b4ff0314cfb3 req-24b901de-60be-4226-91ec-207169faec35 service nova] Enqueued Resource ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 with Priority: HIGHEST for action security_group_rules [ 1185.633705] env[65471]: INFO networking_nsxv3.common.synchronization [req-f5a59c4b-0b6c-402d-9db6-b4ff0314cfb3 req-24b901de-60be-4226-91ec-207169faec35 service nova] Enqueued Resource ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 with Priority: HIGHEST for action security_group_members [ 1185.633834] env[65471]: INFO networking_nsxv3.common.synchronization [req-f5a59c4b-0b6c-402d-9db6-b4ff0314cfb3 req-24b901de-60be-4226-91ec-207169faec35 service nova] Enqueued Resource ID: 1546614c-8fc6-4f14-a565-560d26b4242e with Priority: HIGHEST for action port [ 1185.636916] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 with Priority: HIGHEST for action security_group_rules [ 1185.636916] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 with Priority: HIGHEST for action security_group_members [ 1185.636916] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1546614c-8fc6-4f14-a565-560d26b4242e with Priority: HIGHEST for action port [ 1185.636916] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-735019a1-4315-46a6-b3c7-ec71fdc6ef33 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.637765] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.637920] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.638262] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.638363] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.639571] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-735019a1-4315-46a6-b3c7-ec71fdc6ef33 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.639683] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.640085] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-1546614c-8fc6-4f14-a565-560d26b4242e taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.640278] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1546614c-8fc6-4f14-a565-560d26b4242e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.640367] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1546614c-8fc6-4f14-a565-560d26b4242e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.640656] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1546614c-8fc6-4f14-a565-560d26b4242e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.640786] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1546614c-8fc6-4f14-a565-560d26b4242e',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.684719] env[65471]: INFO networking_nsxv3.common.synchronization [None req-fcc1af77-2809-45f7-a3cc-5c39ab07ea9f tempest-AttachInterfacesTestJSON-1197806586 tempest-AttachInterfacesTestJSON-1197806586-project-member] Enqueued Resource ID: e8869e0a-9385-48b2-ac90-589c8415df21 with Priority: HIGHEST for action security_group_members [ 1185.685320] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8869e0a-9385-48b2-ac90-589c8415df21 with Priority: HIGHEST for action security_group_members [ 1185.685632] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8869e0a-9385-48b2-ac90-589c8415df21 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.685754] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.685835] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.686053] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.686208] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.686308] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.686370] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.686518] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.686598] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.686690] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e8869e0a-9385-48b2-ac90-589c8415df21',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.144403] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-735019a1-4315-46a6-b3c7-ec71fdc6ef33 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.144403] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.144403] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1546614c-8fc6-4f14-a565-560d26b4242e with status ACTIVE [ 1186.144403] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.144403] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.144820] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.144820] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.144820] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.144995] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.145092] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.145151] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.145301] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.145382] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.145620] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.145718] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.145718] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.146920] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.146920] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.146920] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1546614c-8fc6-4f14-a565-560d26b4242e is going to be updated. [ 1186.167266] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.167368] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.167455] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.167748] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.168039] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.168206] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1546614c-8fc6-4f14-a565-560d26b4242e" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.188858] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.188858] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.188858] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.188858] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.188858] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.189218] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.189218] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.189218] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.189379] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.189379] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.189470] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8869e0a-9385-48b2-ac90-589c8415df21 is going to be updated. [ 1186.221759] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.221936] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.222039] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.222398] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.222497] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.234637] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8869e0a-9385-48b2-ac90-589c8415df21 in Status: IN_PROGRESS for 2s [ 1187.580381] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 in Status: SUCCESS [ 1187.580610] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.581072] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.581072] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.581174] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.581268] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.581325] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.581473] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.581547] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.581641] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.085037] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.245741] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8869e0a-9385-48b2-ac90-589c8415df21 in Status: SUCCESS [ 1188.245930] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8869e0a-9385-48b2-ac90-589c8415df21 deletion is rescheduled due to dependency. [ 1188.246071] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.587353] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.090258] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.090435] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.090503] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.090842] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.090921] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.090996] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 is going to be updated. [ 1189.124152] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.124152] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.124152] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.124152] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.124152] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.132852] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 in Status: IN_PROGRESS for 2s [ 1190.686831] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1190.686831] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1191.146435] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 in Status: SUCCESS [ 1191.149029] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.149029] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.149029] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.149029] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.149029] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.149029] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.149029] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.149029] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.149029] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.149029] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.389577] env[65471]: INFO networking_nsxv3.common.synchronization [None req-bc25ed3f-193d-48a6-8c3d-e862f3762b2d None None] Enqueued Resource ID: c8b8ad6a-322e-4d34-80ff-f48cde6daaa3 with Priority: HIGHEST for action port [ 1191.390227] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8b8ad6a-322e-4d34-80ff-f48cde6daaa3 with Priority: HIGHEST for action port [ 1191.390675] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-c8b8ad6a-322e-4d34-80ff-f48cde6daaa3 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.390757] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c8b8ad6a-322e-4d34-80ff-f48cde6daaa3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.393027] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c8b8ad6a-322e-4d34-80ff-f48cde6daaa3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.393027] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c8b8ad6a-322e-4d34-80ff-f48cde6daaa3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.393027] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c8b8ad6a-322e-4d34-80ff-f48cde6daaa3',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.652723] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-735019a1-4315-46a6-b3c7-ec71fdc6ef33 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.653154] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.653154] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.653271] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.653365] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.653456] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.653540] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.654082] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.654188] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.654282] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.654452] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-735019a1-4315-46a6-b3c7-ec71fdc6ef33 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.654572] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.654620] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.654803] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.654943] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.655057] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.655118] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.655260] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.655336] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.655422] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.655512] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.674678] env[65471]: INFO networking_nsxv3.common.synchronization [None req-76214b83-fcfe-4f7c-8fff-45146e23f4f9 tempest-ServersTestFqdnHostnames-2061450103 tempest-ServersTestFqdnHostnames-2061450103-project-member] Enqueued Resource ID: aace9d42-8d1a-4084-977e-6247dec82279 with Priority: HIGHEST for action security_group_rules [ 1191.675480] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aace9d42-8d1a-4084-977e-6247dec82279 with Priority: HIGHEST for action security_group_rules [ 1191.675821] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aace9d42-8d1a-4084-977e-6247dec82279 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.676009] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aace9d42-8d1a-4084-977e-6247dec82279" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.676093] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aace9d42-8d1a-4084-977e-6247dec82279" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.676754] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aace9d42-8d1a-4084-977e-6247dec82279" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.676754] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aace9d42-8d1a-4084-977e-6247dec82279',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.764720] env[65471]: INFO networking_nsxv3.common.synchronization [None req-76e7d3d7-829d-4816-aafe-877144dd1608 tempest-ServersTestFqdnHostnames-2061450103 tempest-ServersTestFqdnHostnames-2061450103-project-member] Enqueued Resource ID: aace9d42-8d1a-4084-977e-6247dec82279 with Priority: HIGHEST for action security_group_rules [ 1191.765415] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aace9d42-8d1a-4084-977e-6247dec82279 with Priority: HIGHEST for action security_group_rules [ 1191.765726] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aace9d42-8d1a-4084-977e-6247dec82279 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.766238] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aace9d42-8d1a-4084-977e-6247dec82279" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.895562] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c8b8ad6a-322e-4d34-80ff-f48cde6daaa3 [ 1191.895924] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.897638] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.897638] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.897638] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.897638] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.897638] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c8b8ad6a-322e-4d34-80ff-f48cde6daaa3 already deleted. [ 1191.897638] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c8b8ad6a-322e-4d34-80ff-f48cde6daaa3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.157623] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 735019a1-4315-46a6-b3c7-ec71fdc6ef33: rpc.has_security_group_logging(os_id): False [ 1192.179183] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.179465] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.179510] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.179842] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.179941] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.180211] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.180316] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.180422] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.180636] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.180741] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.181013] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.181131] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.181195] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.181369] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.181448] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.181707] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.181803] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.181872] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.182055] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.182146] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.182239] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 is going to be updated. [ 1192.204900] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.204900] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.204900] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.204900] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.204900] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.204900] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aace9d42-8d1a-4084-977e-6247dec82279 already deleted. [ 1192.204900] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aace9d42-8d1a-4084-977e-6247dec82279" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.205423] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aace9d42-8d1a-4084-977e-6247dec82279" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.205423] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aace9d42-8d1a-4084-977e-6247dec82279" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.205423] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aace9d42-8d1a-4084-977e-6247dec82279',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.265067] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.265244] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.265315] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.265541] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.265709] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.283599] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 in Status: IN_PROGRESS for 2s [ 1192.736831] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.736831] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.737491] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.737671] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.737959] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.738060] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aace9d42-8d1a-4084-977e-6247dec82279 already deleted. [ 1192.738211] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aace9d42-8d1a-4084-977e-6247dec82279" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.605028] env[65471]: INFO networking_nsxv3.common.synchronization [None req-4c9e16e0-9d6f-4728-a3b1-9f9dee62bb8d None None] Enqueued Resource ID: 2b96dcec-c227-496a-ae64-8b3445a83176 with Priority: HIGHEST for action port [ 1193.605028] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b96dcec-c227-496a-ae64-8b3445a83176 with Priority: HIGHEST for action port [ 1193.605028] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b96dcec-c227-496a-ae64-8b3445a83176 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.605028] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b96dcec-c227-496a-ae64-8b3445a83176" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.605028] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b96dcec-c227-496a-ae64-8b3445a83176" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.605781] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b96dcec-c227-496a-ae64-8b3445a83176" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.605986] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b96dcec-c227-496a-ae64-8b3445a83176',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.108267] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2b96dcec-c227-496a-ae64-8b3445a83176 [ 1194.108498] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.108628] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.108628] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.108808] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.108899] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.109055] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2b96dcec-c227-496a-ae64-8b3445a83176 already deleted. [ 1194.109125] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b96dcec-c227-496a-ae64-8b3445a83176" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.300490] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 in Status: SUCCESS [ 1194.300722] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.695254] env[65471]: INFO networking_nsxv3.common.synchronization [req-0633d626-ed4c-47a8-8a8b-ee03465474ac req-567936b1-dd0e-40ac-a16e-fd4517e90297 tempest-ServerRescueNegativeTestJSON-1570103274 tempest-ServerRescueNegativeTestJSON-1570103274-project-member] Enqueued Resource ID: 6d51d32d-beb9-4c26-b877-a2c1a68caa39 with Priority: HIGHEST for action security_group_members [ 1196.695976] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d51d32d-beb9-4c26-b877-a2c1a68caa39 with Priority: HIGHEST for action security_group_members [ 1196.696343] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d51d32d-beb9-4c26-b877-a2c1a68caa39 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.696483] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d51d32d-beb9-4c26-b877-a2c1a68caa39" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.696531] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d51d32d-beb9-4c26-b877-a2c1a68caa39" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.696729] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d51d32d-beb9-4c26-b877-a2c1a68caa39" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.696879] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.696986] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.697070] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.697220] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.697305] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.697402] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d51d32d-beb9-4c26-b877-a2c1a68caa39',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.999019] env[65471]: INFO networking_nsxv3.common.synchronization [req-b352adb7-486e-443a-8204-4d7ba7de4eb3 req-bc75301d-0c4b-48a0-b814-6e441ae93f7a tempest-AttachVolumeNegativeTest-275281664 tempest-AttachVolumeNegativeTest-275281664-project-member] Enqueued Resource ID: ba0eaf1c-cef3-41f3-a334-f5b6dbf38966 with Priority: HIGHEST for action security_group_members [ 1196.999019] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba0eaf1c-cef3-41f3-a334-f5b6dbf38966 with Priority: HIGHEST for action security_group_members [ 1196.999367] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba0eaf1c-cef3-41f3-a334-f5b6dbf38966 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.999367] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba0eaf1c-cef3-41f3-a334-f5b6dbf38966" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.999367] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba0eaf1c-cef3-41f3-a334-f5b6dbf38966" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.999551] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba0eaf1c-cef3-41f3-a334-f5b6dbf38966" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.999701] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.001193] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.001193] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.001193] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.001193] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.001193] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba0eaf1c-cef3-41f3-a334-f5b6dbf38966',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.203674] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.203674] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.203674] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.203674] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.203674] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.203674] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.203674] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.203674] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.203674] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.203674] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.203674] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d51d32d-beb9-4c26-b877-a2c1a68caa39 is going to be updated. [ 1197.235466] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.235466] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.235466] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.235758] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.235824] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.249504] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d51d32d-beb9-4c26-b877-a2c1a68caa39 in Status: IN_PROGRESS for 2s [ 1197.505228] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.505472] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.505472] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.505710] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.505803] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.506072] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.506283] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.506283] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.506469] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.506469] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.506638] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba0eaf1c-cef3-41f3-a334-f5b6dbf38966 is going to be updated. [ 1197.534680] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.534680] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.534680] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.534680] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.534680] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.543285] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba0eaf1c-cef3-41f3-a334-f5b6dbf38966 in Status: IN_PROGRESS for 2s [ 1197.670285] env[65471]: INFO networking_nsxv3.common.synchronization [req-51da2a0a-2d66-4da4-8221-6ce1676859b3 req-5a47358c-e3c2-43fc-8246-10eb7a129c8b tempest-ServersTestFqdnHostnames-2061450103 tempest-ServersTestFqdnHostnames-2061450103-project-member] Enqueued Resource ID: aace9d42-8d1a-4084-977e-6247dec82279 with Priority: HIGHEST for action security_group_members [ 1197.671399] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aace9d42-8d1a-4084-977e-6247dec82279 with Priority: HIGHEST for action security_group_members [ 1197.675657] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-aace9d42-8d1a-4084-977e-6247dec82279 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.675843] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aace9d42-8d1a-4084-977e-6247dec82279" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.675909] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aace9d42-8d1a-4084-977e-6247dec82279" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.676200] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aace9d42-8d1a-4084-977e-6247dec82279" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.676384] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.676491] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.676552] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.676713] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.676792] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.676887] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aace9d42-8d1a-4084-977e-6247dec82279',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.043640] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock network-182 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.043946] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "network-182" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.043946] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "network-182" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.044616] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "network-182" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.044616] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.044831] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.044831] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.045057] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.045198] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.045405] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1198.045517] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1198.045628] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1198.045758] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1198.045832] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1198.045997] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1198.046101] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1198.066594] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1198.067467] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1198.067708] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1198.067917] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "network-182" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.068286] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock port-cc088a56-30c5-47bd-9ef7-bcea9467916d taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.068476] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "port-cc088a56-30c5-47bd-9ef7-bcea9467916d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.068599] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "port-cc088a56-30c5-47bd-9ef7-bcea9467916d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.068933] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "port-cc088a56-30c5-47bd-9ef7-bcea9467916d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.069195] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc088a56-30c5-47bd-9ef7-bcea9467916d',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.179791] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.179959] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.180610] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.180610] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.180610] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.180813] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.180813] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.180813] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.180963] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.181050] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.181137] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aace9d42-8d1a-4084-977e-6247dec82279 already deleted. [ 1198.181214] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aace9d42-8d1a-4084-977e-6247dec82279" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.571492] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.571728] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.571853] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.572200] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.572353] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.572511] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Segment Port cc088a56-30c5-47bd-9ef7-bcea9467916d not found, creating... [ 1198.572783] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.572980] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.573101] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.573321] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.573457] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.573734] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.573886] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.574007] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.574220] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.574353] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.574489] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Resource: SegmentPort with ID: cc088a56-30c5-47bd-9ef7-bcea9467916d is going to be created. [ 1198.596523] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.596739] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.596837] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.597138] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.597388] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.597618] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "port-cc088a56-30c5-47bd-9ef7-bcea9467916d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.259020] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d51d32d-beb9-4c26-b877-a2c1a68caa39 in Status: SUCCESS [ 1199.259386] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d51d32d-beb9-4c26-b877-a2c1a68caa39 deletion is rescheduled due to dependency. [ 1199.259386] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d51d32d-beb9-4c26-b877-a2c1a68caa39" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.331180] env[65471]: INFO networking_nsxv3.common.synchronization [req-51da2a0a-2d66-4da4-8221-6ce1676859b3 req-c98ee581-441a-4f21-812a-f9cecda87ce3 service nova] Enqueued Resource ID: aace9d42-8d1a-4084-977e-6247dec82279 with Priority: HIGHEST for action security_group_rules [ 1199.331367] env[65471]: INFO networking_nsxv3.common.synchronization [req-51da2a0a-2d66-4da4-8221-6ce1676859b3 req-c98ee581-441a-4f21-812a-f9cecda87ce3 service nova] Enqueued Resource ID: aace9d42-8d1a-4084-977e-6247dec82279 with Priority: HIGHEST for action security_group_members [ 1199.331520] env[65471]: INFO networking_nsxv3.common.synchronization [req-51da2a0a-2d66-4da4-8221-6ce1676859b3 req-c98ee581-441a-4f21-812a-f9cecda87ce3 service nova] Enqueued Resource ID: cc088a56-30c5-47bd-9ef7-bcea9467916d with Priority: HIGHEST for action port [ 1199.331740] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aace9d42-8d1a-4084-977e-6247dec82279 with Priority: HIGHEST for action security_group_rules [ 1199.331862] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aace9d42-8d1a-4084-977e-6247dec82279 with Priority: HIGHEST for action security_group_members [ 1199.331960] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc088a56-30c5-47bd-9ef7-bcea9467916d with Priority: HIGHEST for action port [ 1199.332529] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aace9d42-8d1a-4084-977e-6247dec82279 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.332642] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aace9d42-8d1a-4084-977e-6247dec82279" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.332798] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aace9d42-8d1a-4084-977e-6247dec82279" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.332978] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aace9d42-8d1a-4084-977e-6247dec82279" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.332978] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aace9d42-8d1a-4084-977e-6247dec82279',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.334670] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-aace9d42-8d1a-4084-977e-6247dec82279 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.335624] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aace9d42-8d1a-4084-977e-6247dec82279" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.335624] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aace9d42-8d1a-4084-977e-6247dec82279" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.335624] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aace9d42-8d1a-4084-977e-6247dec82279" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.335624] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.335624] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.335624] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.335624] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.335965] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.335965] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aace9d42-8d1a-4084-977e-6247dec82279',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.336947] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-cc088a56-30c5-47bd-9ef7-bcea9467916d taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.337118] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cc088a56-30c5-47bd-9ef7-bcea9467916d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.337352] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cc088a56-30c5-47bd-9ef7-bcea9467916d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.337522] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cc088a56-30c5-47bd-9ef7-bcea9467916d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.337595] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc088a56-30c5-47bd-9ef7-bcea9467916d',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.553562] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba0eaf1c-cef3-41f3-a334-f5b6dbf38966 in Status: SUCCESS [ 1199.553768] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba0eaf1c-cef3-41f3-a334-f5b6dbf38966 deletion is rescheduled due to dependency. [ 1199.553881] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba0eaf1c-cef3-41f3-a334-f5b6dbf38966" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.837892] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aace9d42-8d1a-4084-977e-6247dec82279',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.838884] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cc088a56-30c5-47bd-9ef7-bcea9467916d with status ACTIVE [ 1199.839102] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.839190] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.839258] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.839970] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.839970] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.839970] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.839970] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.839970] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.840200] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.840200] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.840267] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.840331] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.840488] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.840542] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.840606] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.840692] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cc088a56-30c5-47bd-9ef7-bcea9467916d is going to be updated. [ 1199.841869] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-aace9d42-8d1a-4084-977e-6247dec82279 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.841959] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aace9d42-8d1a-4084-977e-6247dec82279" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.863906] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.864118] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.864118] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.864239] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.864373] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.864530] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cc088a56-30c5-47bd-9ef7-bcea9467916d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.930200] env[65471]: INFO networking_nsxv3.common.synchronization [req-5587fc79-0ccf-4e68-ac7d-03add8243e0b req-274b8eeb-5668-4f6d-8c8e-0eeeecbcb8a2 tempest-ServersTestJSON-569130442 tempest-ServersTestJSON-569130442-project-member] Enqueued Resource ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 with Priority: HIGHEST for action security_group_members [ 1199.931179] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 with Priority: HIGHEST for action security_group_members [ 1199.931494] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-735019a1-4315-46a6-b3c7-ec71fdc6ef33 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.931614] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.931691] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.931889] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.932058] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.932176] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.932244] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.932382] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.932468] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.932558] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.343221] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aace9d42-8d1a-4084-977e-6247dec82279',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.435518] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.847149] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.847327] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.847387] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.847607] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.847697] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.847802] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aace9d42-8d1a-4084-977e-6247dec82279 is going to be created. [ 1200.864283] env[65471]: INFO networking_nsxv3.common.synchronization [req-92f6b1b1-0e9f-4086-9a70-cd98f5cfae40 req-32308f46-b83e-40ec-b5b0-a70e25e92915 tempest-ServerActionsTestJSON-1061383532 tempest-ServerActionsTestJSON-1061383532-project-member] Enqueued Resource ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 with Priority: HIGHEST for action security_group_members [ 1200.865345] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 with Priority: HIGHEST for action security_group_members [ 1200.866233] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-401f7079-c4c2-4951-b6ae-bc1cfbb23228 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.866233] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.866233] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.866233] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.866444] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.866444] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.866516] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.866627] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.866789] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.866912] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('401f7079-c4c2-4951-b6ae-bc1cfbb23228',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.873061] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.873185] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.873248] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.873430] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.873583] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.886442] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aace9d42-8d1a-4084-977e-6247dec82279 in Status: UNINITIALIZED for 2s [ 1200.937912] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.369468] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.369861] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.369861] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.369861] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.370045] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.370223] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.370290] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.370333] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.370472] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.370550] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.370641] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 is going to be updated. [ 1201.417581] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.417803] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.417803] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.417990] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.418150] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.427952] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 in Status: IN_PROGRESS for 2s [ 1201.441573] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.441720] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.441791] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.442043] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.442151] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.442263] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 is going to be updated. [ 1201.473670] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.474156] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.474156] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.474252] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.474419] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.484528] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 in Status: IN_PROGRESS for 2s [ 1202.897143] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aace9d42-8d1a-4084-977e-6247dec82279 in Status: SUCCESS [ 1202.897474] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aace9d42-8d1a-4084-977e-6247dec82279" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.897618] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aace9d42-8d1a-4084-977e-6247dec82279" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.897847] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aace9d42-8d1a-4084-977e-6247dec82279" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.898073] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.898258] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.898332] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.898491] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.898574] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.898700] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aace9d42-8d1a-4084-977e-6247dec82279" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.898803] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aace9d42-8d1a-4084-977e-6247dec82279',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.149045] env[65471]: INFO networking_nsxv3.common.synchronization [None req-460c3701-dc22-43b9-9480-7a5573df01f9 tempest-AttachVolumeNegativeTest-275281664 tempest-AttachVolumeNegativeTest-275281664-project-member] Enqueued Resource ID: 4d21733d-db9f-4e61-bcaf-373b43488925 with Priority: HIGHEST for action security_group_rules [ 1203.149709] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d21733d-db9f-4e61-bcaf-373b43488925 with Priority: HIGHEST for action security_group_rules [ 1203.150044] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4d21733d-db9f-4e61-bcaf-373b43488925 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.150178] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4d21733d-db9f-4e61-bcaf-373b43488925" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.150250] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4d21733d-db9f-4e61-bcaf-373b43488925" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.150488] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4d21733d-db9f-4e61-bcaf-373b43488925" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.150575] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4d21733d-db9f-4e61-bcaf-373b43488925',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.246986] env[65471]: INFO networking_nsxv3.common.synchronization [None req-99f133ec-ef69-45f9-8f49-4816e6f57bf2 tempest-AttachVolumeNegativeTest-275281664 tempest-AttachVolumeNegativeTest-275281664-project-member] Enqueued Resource ID: 4d21733d-db9f-4e61-bcaf-373b43488925 with Priority: HIGHEST for action security_group_rules [ 1203.247518] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d21733d-db9f-4e61-bcaf-373b43488925 with Priority: HIGHEST for action security_group_rules [ 1203.247854] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4d21733d-db9f-4e61-bcaf-373b43488925 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.247956] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4d21733d-db9f-4e61-bcaf-373b43488925" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.402684] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aace9d42-8d1a-4084-977e-6247dec82279',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.441342] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 in Status: SUCCESS [ 1203.441546] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 deletion is rescheduled due to dependency. [ 1203.441707] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.498275] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 in Status: SUCCESS [ 1203.499124] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.679311] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.679495] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.679495] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.680013] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.680170] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.680278] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4d21733d-db9f-4e61-bcaf-373b43488925 already deleted. [ 1203.680365] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4d21733d-db9f-4e61-bcaf-373b43488925" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.680529] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4d21733d-db9f-4e61-bcaf-373b43488925" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.680697] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4d21733d-db9f-4e61-bcaf-373b43488925" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.680774] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4d21733d-db9f-4e61-bcaf-373b43488925',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.905801] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aace9d42-8d1a-4084-977e-6247dec82279: rpc.has_security_group_logging(os_id): False [ 1203.925419] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.925614] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.925688] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.925847] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.925936] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.926250] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.926399] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.926463] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.926608] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.926706] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.926800] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aace9d42-8d1a-4084-977e-6247dec82279 is going to be created. [ 1203.988517] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.988710] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.988710] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.988924] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.989129] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.000638] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aace9d42-8d1a-4084-977e-6247dec82279 in Status: IN_PROGRESS for 2s [ 1204.225518] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.225712] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.225785] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.226060] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.226380] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.227224] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4d21733d-db9f-4e61-bcaf-373b43488925 already deleted. [ 1204.227224] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4d21733d-db9f-4e61-bcaf-373b43488925" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.812937] env[65471]: INFO networking_nsxv3.common.synchronization [req-fef5869b-eae4-4adf-a584-b094cb922267 req-3ca2dfc3-f542-412f-95a5-4963cafd73ec tempest-AttachVolumeTestJSON-782575626 tempest-AttachVolumeTestJSON-782575626-project-member] Enqueued Resource ID: 748c6b66-3e73-44a5-8430-c76b55ad8ee3 with Priority: HIGHEST for action security_group_members [ 1204.814026] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 748c6b66-3e73-44a5-8430-c76b55ad8ee3 with Priority: HIGHEST for action security_group_members [ 1204.814264] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-748c6b66-3e73-44a5-8430-c76b55ad8ee3 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.814517] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-748c6b66-3e73-44a5-8430-c76b55ad8ee3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.814646] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-748c6b66-3e73-44a5-8430-c76b55ad8ee3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.814947] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-748c6b66-3e73-44a5-8430-c76b55ad8ee3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.815306] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.815543] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.815723] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.816036] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.816236] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.817387] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('748c6b66-3e73-44a5-8430-c76b55ad8ee3',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.321011] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.321379] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.321379] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.321560] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.321664] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.321893] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.321997] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.322083] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.322244] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.322322] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.322419] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 748c6b66-3e73-44a5-8430-c76b55ad8ee3 is going to be updated. [ 1205.353224] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.353467] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.353526] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.353798] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.353946] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.363136] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 748c6b66-3e73-44a5-8430-c76b55ad8ee3 in Status: IN_PROGRESS for 2s [ 1206.011821] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aace9d42-8d1a-4084-977e-6247dec82279 in Status: SUCCESS [ 1206.012111] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aace9d42-8d1a-4084-977e-6247dec82279" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.375889] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 748c6b66-3e73-44a5-8430-c76b55ad8ee3 in Status: SUCCESS [ 1207.376302] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 748c6b66-3e73-44a5-8430-c76b55ad8ee3 deletion is rescheduled due to dependency. [ 1207.376360] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-748c6b66-3e73-44a5-8430-c76b55ad8ee3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.601915] env[65471]: INFO networking_nsxv3.common.synchronization [req-f98f0adc-5e17-4c8b-b351-723fb361e51e req-9dd3420d-5219-469a-852f-43afe0731524 tempest-ServersTestJSON-569130442 tempest-ServersTestJSON-569130442-project-member] Enqueued Resource ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 with Priority: HIGHEST for action security_group_members [ 1207.602822] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 with Priority: HIGHEST for action security_group_members [ 1207.603309] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-735019a1-4315-46a6-b3c7-ec71fdc6ef33 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.603539] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.603680] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.603888] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.604175] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.604333] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.604458] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.604721] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.604837] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.604989] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.107387] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.107577] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.107669] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.107869] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.107962] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.108214] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.108308] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.108377] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.108528] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.108607] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.108695] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 is going to be updated. [ 1208.138762] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.138905] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.138976] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.139275] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.139577] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.150849] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 in Status: IN_PROGRESS for 2s [ 1208.263858] env[65471]: INFO networking_nsxv3.common.synchronization [req-602ef75e-3e66-47f0-89b9-a48c40c3c711 req-8cdee592-e3f9-47da-97af-2d63c80715fc tempest-ServerRescueNegativeTestJSON-1570103274 tempest-ServerRescueNegativeTestJSON-1570103274-project-member] Enqueued Resource ID: 2e3bdef3-6800-4bd2-84b8-3ef120fd62f1 with Priority: HIGHEST for action security_group_members [ 1208.264420] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e3bdef3-6800-4bd2-84b8-3ef120fd62f1 with Priority: HIGHEST for action security_group_members [ 1208.265097] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.265097] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.265097] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.265599] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.265599] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.265599] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.265599] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.265951] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.265951] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.265951] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e3bdef3-6800-4bd2-84b8-3ef120fd62f1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.768065] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2e3bdef3-6800-4bd2-84b8-3ef120fd62f1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.993313] env[65471]: INFO networking_nsxv3.common.synchronization [req-ef6894db-904b-4a42-99d0-099fd5d9dd3a req-042684cb-5ffb-4aff-90ec-97b3849f5313 tempest-AttachVolumeNegativeTest-275281664 tempest-AttachVolumeNegativeTest-275281664-project-member] Enqueued Resource ID: 4d21733d-db9f-4e61-bcaf-373b43488925 with Priority: HIGHEST for action security_group_members [ 1208.994077] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d21733d-db9f-4e61-bcaf-373b43488925 with Priority: HIGHEST for action security_group_members [ 1208.994257] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d21733d-db9f-4e61-bcaf-373b43488925 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.994391] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d21733d-db9f-4e61-bcaf-373b43488925" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.994483] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d21733d-db9f-4e61-bcaf-373b43488925" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.994724] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d21733d-db9f-4e61-bcaf-373b43488925" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.995757] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.995757] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.995757] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.995757] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.995757] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.995757] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4d21733d-db9f-4e61-bcaf-373b43488925',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.271290] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2e3bdef3-6800-4bd2-84b8-3ef120fd62f1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.395239] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock network-507 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.395397] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "network-507" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.395639] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "network-507" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.395788] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "network-507" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.396113] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.396248] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.396382] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.396547] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.396982] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.396982] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1209.396982] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1209.397188] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1209.397336] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1209.397499] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1209.397644] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1209.397831] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1209.419308] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1209.419308] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1209.419308] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1209.419308] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "network-507" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.419678] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock port-cf828483-0ee4-4d93-83f8-c1c62d735476 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.419807] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "port-cf828483-0ee4-4d93-83f8-c1c62d735476" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.419861] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "port-cf828483-0ee4-4d93-83f8-c1c62d735476" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.420325] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "port-cf828483-0ee4-4d93-83f8-c1c62d735476" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.420478] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf828483-0ee4-4d93-83f8-c1c62d735476',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.499737] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.500043] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.500043] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.500209] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.500303] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.500645] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.500645] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.501329] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.501329] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.501329] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.501329] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4d21733d-db9f-4e61-bcaf-373b43488925 already deleted. [ 1209.501329] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d21733d-db9f-4e61-bcaf-373b43488925" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.774375] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.774375] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.774375] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.774375] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.774375] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.774795] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e3bdef3-6800-4bd2-84b8-3ef120fd62f1 is going to be updated. [ 1209.804794] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.805281] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.805281] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.805448] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.809024] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.816560] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e3bdef3-6800-4bd2-84b8-3ef120fd62f1 in Status: IN_PROGRESS for 2s [ 1209.923240] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.923879] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.924117] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.924497] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.924728] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.925020] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Segment Port cf828483-0ee4-4d93-83f8-c1c62d735476 not found, creating... [ 1209.925265] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.925483] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.925626] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.925889] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.926172] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.926415] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.926656] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.926806] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.927055] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.927226] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.927948] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Resource: SegmentPort with ID: cf828483-0ee4-4d93-83f8-c1c62d735476 is going to be created. [ 1209.950205] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.950447] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.950676] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.951024] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.951390] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.951734] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "port-cf828483-0ee4-4d93-83f8-c1c62d735476" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.162252] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 in Status: SUCCESS [ 1210.162978] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 deletion is rescheduled due to dependency. [ 1210.162978] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.673466] env[65471]: INFO networking_nsxv3.common.synchronization [req-ef6894db-904b-4a42-99d0-099fd5d9dd3a req-355b0d19-597d-4ef3-8e97-f76cf389f7cb service nova] Enqueued Resource ID: 4d21733d-db9f-4e61-bcaf-373b43488925 with Priority: HIGHEST for action security_group_rules [ 1210.673770] env[65471]: INFO networking_nsxv3.common.synchronization [req-ef6894db-904b-4a42-99d0-099fd5d9dd3a req-355b0d19-597d-4ef3-8e97-f76cf389f7cb service nova] Enqueued Resource ID: 4d21733d-db9f-4e61-bcaf-373b43488925 with Priority: HIGHEST for action security_group_members [ 1210.674018] env[65471]: INFO networking_nsxv3.common.synchronization [req-ef6894db-904b-4a42-99d0-099fd5d9dd3a req-355b0d19-597d-4ef3-8e97-f76cf389f7cb service nova] Enqueued Resource ID: cf828483-0ee4-4d93-83f8-c1c62d735476 with Priority: HIGHEST for action port [ 1210.674608] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d21733d-db9f-4e61-bcaf-373b43488925 with Priority: HIGHEST for action security_group_rules [ 1210.674811] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d21733d-db9f-4e61-bcaf-373b43488925 with Priority: HIGHEST for action security_group_members [ 1210.674980] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf828483-0ee4-4d93-83f8-c1c62d735476 with Priority: HIGHEST for action port [ 1210.675403] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4d21733d-db9f-4e61-bcaf-373b43488925 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.675584] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4d21733d-db9f-4e61-bcaf-373b43488925" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.675702] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4d21733d-db9f-4e61-bcaf-373b43488925" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.675963] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4d21733d-db9f-4e61-bcaf-373b43488925" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.676121] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4d21733d-db9f-4e61-bcaf-373b43488925',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.677896] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d21733d-db9f-4e61-bcaf-373b43488925 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.677896] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d21733d-db9f-4e61-bcaf-373b43488925" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.677896] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d21733d-db9f-4e61-bcaf-373b43488925" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.678724] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d21733d-db9f-4e61-bcaf-373b43488925" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.678724] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.678724] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.678724] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.678957] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.679075] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.679196] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4d21733d-db9f-4e61-bcaf-373b43488925',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.680931] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-cf828483-0ee4-4d93-83f8-c1c62d735476 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.680931] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cf828483-0ee4-4d93-83f8-c1c62d735476" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.681120] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cf828483-0ee4-4d93-83f8-c1c62d735476" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.681208] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cf828483-0ee4-4d93-83f8-c1c62d735476" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.681289] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf828483-0ee4-4d93-83f8-c1c62d735476',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.183561] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4d21733d-db9f-4e61-bcaf-373b43488925',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.184703] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d21733d-db9f-4e61-bcaf-373b43488925 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.184927] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d21733d-db9f-4e61-bcaf-373b43488925" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.185269] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cf828483-0ee4-4d93-83f8-c1c62d735476 with status ACTIVE [ 1211.185530] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.185632] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.185689] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.185941] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.188943] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.188943] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.188943] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.188943] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.188943] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.188943] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.188943] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.188943] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.188943] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.188943] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.188943] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.188943] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cf828483-0ee4-4d93-83f8-c1c62d735476 is going to be updated. [ 1211.212900] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.213246] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.213405] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.213788] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.213958] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.214169] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cf828483-0ee4-4d93-83f8-c1c62d735476" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.481165] env[65471]: INFO networking_nsxv3.common.synchronization [req-7a505a66-550c-4c11-9ce6-100d76831403 req-931a84cc-12fc-4179-9775-0d21f2d7dad5 tempest-ServerActionsTestJSON-1061383532 tempest-ServerActionsTestJSON-1061383532-project-member] Enqueued Resource ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 with Priority: HIGHEST for action security_group_members [ 1211.481165] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 with Priority: HIGHEST for action security_group_members [ 1211.481165] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-401f7079-c4c2-4951-b6ae-bc1cfbb23228 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.481165] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.481165] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.481980] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.482438] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.482692] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.482860] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.483146] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.483353] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.483631] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('401f7079-c4c2-4951-b6ae-bc1cfbb23228',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.690267] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4d21733d-db9f-4e61-bcaf-373b43488925',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.823818] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock network-487 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.824038] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "network-487" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.824196] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "network-487" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.824519] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "network-487" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.824827] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.825041] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.825255] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.825491] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.825646] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.825852] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1211.825980] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1211.826140] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1211.826218] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1211.826303] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1211.826404] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1211.826531] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1211.828459] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e3bdef3-6800-4bd2-84b8-3ef120fd62f1 in Status: SUCCESS [ 1211.828647] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.846462] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1211.846648] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1211.846788] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1211.846971] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "network-487" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.847371] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock port-e3a90a68-c44c-4adc-a61f-9f9c0aeeabba taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.847516] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "port-e3a90a68-c44c-4adc-a61f-9f9c0aeeabba" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.847634] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "port-e3a90a68-c44c-4adc-a61f-9f9c0aeeabba" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.847960] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "port-e3a90a68-c44c-4adc-a61f-9f9c0aeeabba" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.848215] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3a90a68-c44c-4adc-a61f-9f9c0aeeabba',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.985685] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.985901] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.985901] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.986227] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.986310] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.986530] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.986632] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.986687] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.986845] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.986921] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.987017] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 is going to be updated. [ 1212.015030] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.015030] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.015030] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.015030] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.015030] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.025213] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 in Status: IN_PROGRESS for 2s [ 1212.193575] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.193961] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.193961] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.194073] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.194124] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.194234] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4d21733d-db9f-4e61-bcaf-373b43488925 is going to be created. [ 1212.221524] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.221524] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.221771] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.221771] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.222020] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.231732] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4d21733d-db9f-4e61-bcaf-373b43488925 in Status: UNINITIALIZED for 2s [ 1212.350189] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.350477] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.350610] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.350946] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.351134] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.351293] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Segment Port e3a90a68-c44c-4adc-a61f-9f9c0aeeabba not found, creating... [ 1212.351605] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.351784] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.351890] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.352117] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.352269] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.352576] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.352734] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.352840] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.353099] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.353279] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.353435] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Resource: SegmentPort with ID: e3a90a68-c44c-4adc-a61f-9f9c0aeeabba is going to be created. [ 1212.374410] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.374686] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.374880] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.375294] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.375639] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.375985] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "port-e3a90a68-c44c-4adc-a61f-9f9c0aeeabba" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.079187] env[65471]: INFO networking_nsxv3.common.synchronization [req-7a505a66-550c-4c11-9ce6-100d76831403 req-11d6fb46-79a8-416c-bbb7-30d78b58d3eb service nova] Enqueued Resource ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 with Priority: HIGHEST for action security_group_rules [ 1213.080078] env[65471]: INFO networking_nsxv3.common.synchronization [req-7a505a66-550c-4c11-9ce6-100d76831403 req-11d6fb46-79a8-416c-bbb7-30d78b58d3eb service nova] Enqueued Resource ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 with Priority: HIGHEST for action security_group_members [ 1213.080078] env[65471]: INFO networking_nsxv3.common.synchronization [req-7a505a66-550c-4c11-9ce6-100d76831403 req-11d6fb46-79a8-416c-bbb7-30d78b58d3eb service nova] Enqueued Resource ID: e3a90a68-c44c-4adc-a61f-9f9c0aeeabba with Priority: HIGHEST for action port [ 1213.080459] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 with Priority: HIGHEST for action security_group_rules [ 1213.080667] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 with Priority: HIGHEST for action security_group_members [ 1213.080828] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3a90a68-c44c-4adc-a61f-9f9c0aeeabba with Priority: HIGHEST for action port [ 1213.081242] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-401f7079-c4c2-4951-b6ae-bc1cfbb23228 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.081545] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.081672] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.081973] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.082157] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('401f7079-c4c2-4951-b6ae-bc1cfbb23228',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.084171] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-401f7079-c4c2-4951-b6ae-bc1cfbb23228 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.084171] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.084354] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-e3a90a68-c44c-4adc-a61f-9f9c0aeeabba taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.084512] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e3a90a68-c44c-4adc-a61f-9f9c0aeeabba" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.084628] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e3a90a68-c44c-4adc-a61f-9f9c0aeeabba" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.084910] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e3a90a68-c44c-4adc-a61f-9f9c0aeeabba" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.085104] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3a90a68-c44c-4adc-a61f-9f9c0aeeabba',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.587116] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-401f7079-c4c2-4951-b6ae-bc1cfbb23228 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.587484] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.587484] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e3a90a68-c44c-4adc-a61f-9f9c0aeeabba with status ACTIVE [ 1213.587814] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.587917] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.587951] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.588304] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.588445] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.588717] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.588909] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.588909] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.589157] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.589301] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.589550] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.589718] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.589822] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.589995] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.590145] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.590278] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e3a90a68-c44c-4adc-a61f-9f9c0aeeabba is going to be updated. [ 1213.616401] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.616592] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.616592] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.616920] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.617191] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.617263] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e3a90a68-c44c-4adc-a61f-9f9c0aeeabba" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.767887] env[65471]: INFO networking_nsxv3.common.synchronization [None req-4b0618cb-692c-4737-9aef-7eebd12b34cf tempest-AttachVolumeTestJSON-782575626 tempest-AttachVolumeTestJSON-782575626-project-member] Enqueued Resource ID: bb4dda56-d5fb-4d9e-a613-8204b35459b5 with Priority: HIGHEST for action security_group_rules [ 1213.768473] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb4dda56-d5fb-4d9e-a613-8204b35459b5 with Priority: HIGHEST for action security_group_rules [ 1213.768798] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bb4dda56-d5fb-4d9e-a613-8204b35459b5 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.769326] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bb4dda56-d5fb-4d9e-a613-8204b35459b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.769326] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bb4dda56-d5fb-4d9e-a613-8204b35459b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.769326] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bb4dda56-d5fb-4d9e-a613-8204b35459b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.769326] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bb4dda56-d5fb-4d9e-a613-8204b35459b5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.861978] env[65471]: INFO networking_nsxv3.common.synchronization [None req-0ee61000-c156-4596-b026-b2265367d159 tempest-AttachVolumeTestJSON-782575626 tempest-AttachVolumeTestJSON-782575626-project-member] Enqueued Resource ID: bb4dda56-d5fb-4d9e-a613-8204b35459b5 with Priority: HIGHEST for action security_group_rules [ 1213.861978] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb4dda56-d5fb-4d9e-a613-8204b35459b5 with Priority: HIGHEST for action security_group_rules [ 1213.861978] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bb4dda56-d5fb-4d9e-a613-8204b35459b5 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.861978] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bb4dda56-d5fb-4d9e-a613-8204b35459b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.035594] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 in Status: SUCCESS [ 1214.035803] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 deletion is rescheduled due to dependency. [ 1214.035946] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.036162] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.036411] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.036599] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.036732] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.036800] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.036981] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.037091] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.037209] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('401f7079-c4c2-4951-b6ae-bc1cfbb23228',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.243178] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4d21733d-db9f-4e61-bcaf-373b43488925 in Status: UNINITIALIZED for 4s [ 1214.292535] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.292802] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.292802] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.292997] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.293119] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.293320] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bb4dda56-d5fb-4d9e-a613-8204b35459b5 already deleted. [ 1214.293413] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bb4dda56-d5fb-4d9e-a613-8204b35459b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.293582] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bb4dda56-d5fb-4d9e-a613-8204b35459b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.293763] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bb4dda56-d5fb-4d9e-a613-8204b35459b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.293842] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bb4dda56-d5fb-4d9e-a613-8204b35459b5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.539190] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('401f7079-c4c2-4951-b6ae-bc1cfbb23228',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.815981] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.815981] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.815981] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.816555] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.816555] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.816555] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bb4dda56-d5fb-4d9e-a613-8204b35459b5 already deleted. [ 1214.816555] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bb4dda56-d5fb-4d9e-a613-8204b35459b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.041760] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('401f7079-c4c2-4951-b6ae-bc1cfbb23228',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.544986] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.545144] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.545233] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.545449] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.545540] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.545647] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 is going to be updated. [ 1215.574438] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.574570] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.574570] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.574774] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.574917] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.586990] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 in Status: IN_PROGRESS for 2s [ 1216.259983] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4d21733d-db9f-4e61-bcaf-373b43488925 in Status: SUCCESS [ 1216.260397] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d21733d-db9f-4e61-bcaf-373b43488925" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.260540] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d21733d-db9f-4e61-bcaf-373b43488925" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.260828] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d21733d-db9f-4e61-bcaf-373b43488925" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.261155] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.261357] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.261445] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.261696] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.261907] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.262087] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d21733d-db9f-4e61-bcaf-373b43488925" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.262225] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4d21733d-db9f-4e61-bcaf-373b43488925',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.768856] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4d21733d-db9f-4e61-bcaf-373b43488925',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.272570] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4d21733d-db9f-4e61-bcaf-373b43488925: rpc.has_security_group_logging(os_id): False [ 1217.292562] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.292562] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.292562] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.292791] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.292868] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.293119] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.293248] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.293290] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.293429] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.293503] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.293609] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4d21733d-db9f-4e61-bcaf-373b43488925 is going to be created. [ 1217.463322] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.463322] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.463322] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.463322] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.463322] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.473900] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4d21733d-db9f-4e61-bcaf-373b43488925 in Status: IN_PROGRESS for 2s [ 1217.605770] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 in Status: SUCCESS [ 1217.605982] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.606186] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.606497] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.606715] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.606851] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.606924] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.607114] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.607215] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.607320] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.607428] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('401f7079-c4c2-4951-b6ae-bc1cfbb23228',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.109994] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('401f7079-c4c2-4951-b6ae-bc1cfbb23228',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.613209] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 401f7079-c4c2-4951-b6ae-bc1cfbb23228: rpc.has_security_group_logging(os_id): False [ 1218.632516] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.632765] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.632765] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.632971] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.633078] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.633387] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.633496] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.633560] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.633719] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.633799] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.633891] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 is going to be updated. [ 1218.700546] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.700546] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.700803] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.700850] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.701175] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.716134] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 in Status: IN_PROGRESS for 2s [ 1218.862076] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1218.862290] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1219.489205] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4d21733d-db9f-4e61-bcaf-373b43488925 in Status: SUCCESS [ 1219.489409] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4d21733d-db9f-4e61-bcaf-373b43488925" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.571852] env[65471]: INFO networking_nsxv3.common.synchronization [req-036e80d6-a343-41f3-9f4f-491db91a4c5c req-00344da7-3fa3-4b6e-bbc0-965e05c56462 tempest-ServerRescueNegativeTestJSON-1570103274 tempest-ServerRescueNegativeTestJSON-1570103274-project-member] Enqueued Resource ID: 2e3bdef3-6800-4bd2-84b8-3ef120fd62f1 with Priority: HIGHEST for action security_group_members [ 1219.572421] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e3bdef3-6800-4bd2-84b8-3ef120fd62f1 with Priority: HIGHEST for action security_group_members [ 1219.572763] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.572891] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.572950] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.574318] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.574434] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.574504] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.574557] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.574842] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.574842] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.574942] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e3bdef3-6800-4bd2-84b8-3ef120fd62f1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.077018] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.077393] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.077393] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.077516] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.077608] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.077844] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.077949] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.078092] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.078233] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.078313] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.078401] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e3bdef3-6800-4bd2-84b8-3ef120fd62f1 is going to be updated. [ 1220.105779] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.106540] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.106540] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.107227] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.107227] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.115756] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e3bdef3-6800-4bd2-84b8-3ef120fd62f1 in Status: IN_PROGRESS for 2s [ 1220.728761] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 in Status: SUCCESS [ 1220.728986] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.124935] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e3bdef3-6800-4bd2-84b8-3ef120fd62f1 in Status: SUCCESS [ 1222.125470] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e3bdef3-6800-4bd2-84b8-3ef120fd62f1 deletion is rescheduled due to dependency. [ 1222.125470] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.718638] env[65471]: INFO networking_nsxv3.common.synchronization [req-1024395e-50cb-4794-99c8-8a498006aed4 req-a12478b4-9e11-4865-b625-a0ae5a55f0d9 tempest-AttachVolumeTestJSON-782575626 tempest-AttachVolumeTestJSON-782575626-project-member] Enqueued Resource ID: bb4dda56-d5fb-4d9e-a613-8204b35459b5 with Priority: HIGHEST for action security_group_members [ 1223.719038] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb4dda56-d5fb-4d9e-a613-8204b35459b5 with Priority: HIGHEST for action security_group_members [ 1223.719515] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb4dda56-d5fb-4d9e-a613-8204b35459b5 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.720430] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb4dda56-d5fb-4d9e-a613-8204b35459b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.720677] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb4dda56-d5fb-4d9e-a613-8204b35459b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.721074] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb4dda56-d5fb-4d9e-a613-8204b35459b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.721512] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.723091] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.723091] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.723091] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.723091] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.723091] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb4dda56-d5fb-4d9e-a613-8204b35459b5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.094425] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock network-906 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.094425] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "network-906" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.094425] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "network-906" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.094425] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "network-906" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.094425] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.094683] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.094683] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.094884] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.095040] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.095283] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1224.095416] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1224.095557] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1224.095675] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1224.095788] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1224.095893] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1224.096046] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1224.117493] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1224.117691] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1224.117838] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1224.118033] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "network-906" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.118367] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock port-46d5cc5f-1ff2-4356-b17c-0a092d6eef11 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.118542] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "port-46d5cc5f-1ff2-4356-b17c-0a092d6eef11" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.118664] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "port-46d5cc5f-1ff2-4356-b17c-0a092d6eef11" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.119048] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "port-46d5cc5f-1ff2-4356-b17c-0a092d6eef11" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.119217] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46d5cc5f-1ff2-4356-b17c-0a092d6eef11',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.224721] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.224932] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.225029] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.225212] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.225371] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.225597] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.225704] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.225861] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.225918] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.225970] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.226063] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb4dda56-d5fb-4d9e-a613-8204b35459b5 already deleted. [ 1224.226156] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb4dda56-d5fb-4d9e-a613-8204b35459b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.622599] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.622836] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.622963] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.623358] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.623549] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.623716] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Segment Port 46d5cc5f-1ff2-4356-b17c-0a092d6eef11 not found, creating... [ 1224.624042] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.624180] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.624302] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.624536] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.624701] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.624977] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.625802] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.626063] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.626945] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.627136] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.627735] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Resource: SegmentPort with ID: 46d5cc5f-1ff2-4356-b17c-0a092d6eef11 is going to be created. [ 1224.651364] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.651618] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.651812] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.652030] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.652261] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.652495] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "port-46d5cc5f-1ff2-4356-b17c-0a092d6eef11" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.032673] env[65471]: INFO networking_nsxv3.common.synchronization [req-5b096287-3b41-40f8-922e-d02825c1886b req-7ca6147e-1fc9-4558-9ed5-18fc42739076 tempest-DeleteServersTestJSON-72429361 tempest-DeleteServersTestJSON-72429361-project-member] Enqueued Resource ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 with Priority: HIGHEST for action security_group_members [ 1225.033452] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 with Priority: HIGHEST for action security_group_members [ 1225.033907] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-c35d5123-3fe1-447f-aedc-8112e5faa2b6 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.034089] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.034236] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.034599] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.034838] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.034993] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.035108] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.035379] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.035551] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.035656] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c35d5123-3fe1-447f-aedc-8112e5faa2b6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.378735] env[65471]: INFO networking_nsxv3.common.synchronization [req-1024395e-50cb-4794-99c8-8a498006aed4 req-0d0f987a-6f12-4590-8391-a1cd6a0e15c5 service nova] Enqueued Resource ID: bb4dda56-d5fb-4d9e-a613-8204b35459b5 with Priority: HIGHEST for action security_group_rules [ 1225.378735] env[65471]: INFO networking_nsxv3.common.synchronization [req-1024395e-50cb-4794-99c8-8a498006aed4 req-0d0f987a-6f12-4590-8391-a1cd6a0e15c5 service nova] Enqueued Resource ID: bb4dda56-d5fb-4d9e-a613-8204b35459b5 with Priority: HIGHEST for action security_group_members [ 1225.378949] env[65471]: INFO networking_nsxv3.common.synchronization [req-1024395e-50cb-4794-99c8-8a498006aed4 req-0d0f987a-6f12-4590-8391-a1cd6a0e15c5 service nova] Enqueued Resource ID: 46d5cc5f-1ff2-4356-b17c-0a092d6eef11 with Priority: HIGHEST for action port [ 1225.379373] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb4dda56-d5fb-4d9e-a613-8204b35459b5 with Priority: HIGHEST for action security_group_rules [ 1225.379507] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb4dda56-d5fb-4d9e-a613-8204b35459b5 with Priority: HIGHEST for action security_group_members [ 1225.379607] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46d5cc5f-1ff2-4356-b17c-0a092d6eef11 with Priority: HIGHEST for action port [ 1225.379970] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bb4dda56-d5fb-4d9e-a613-8204b35459b5 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.380067] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bb4dda56-d5fb-4d9e-a613-8204b35459b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.380067] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bb4dda56-d5fb-4d9e-a613-8204b35459b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.380244] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bb4dda56-d5fb-4d9e-a613-8204b35459b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.380327] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bb4dda56-d5fb-4d9e-a613-8204b35459b5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.381162] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb4dda56-d5fb-4d9e-a613-8204b35459b5 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.381275] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb4dda56-d5fb-4d9e-a613-8204b35459b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.381343] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb4dda56-d5fb-4d9e-a613-8204b35459b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.381499] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb4dda56-d5fb-4d9e-a613-8204b35459b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.381644] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.381735] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.381796] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.381959] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.382018] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.382113] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb4dda56-d5fb-4d9e-a613-8204b35459b5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.383092] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-46d5cc5f-1ff2-4356-b17c-0a092d6eef11 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.383197] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-46d5cc5f-1ff2-4356-b17c-0a092d6eef11" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.383392] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-46d5cc5f-1ff2-4356-b17c-0a092d6eef11" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.383469] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-46d5cc5f-1ff2-4356-b17c-0a092d6eef11" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.383469] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46d5cc5f-1ff2-4356-b17c-0a092d6eef11',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.539179] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.539379] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.539379] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.539605] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.540015] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.540385] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.540385] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.540523] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.540580] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.540659] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.540746] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 is going to be updated. [ 1225.570794] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.570976] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.571033] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.572148] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.572148] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.581391] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 in Status: IN_PROGRESS for 2s [ 1225.885621] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb4dda56-d5fb-4d9e-a613-8204b35459b5 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.886051] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb4dda56-d5fb-4d9e-a613-8204b35459b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.886051] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bb4dda56-d5fb-4d9e-a613-8204b35459b5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.888454] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 46d5cc5f-1ff2-4356-b17c-0a092d6eef11 with status ACTIVE [ 1225.888683] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.888808] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.888896] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.889171] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.889233] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.889445] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.889516] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.889564] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.889694] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.889739] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.889912] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.890019] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.890074] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.890204] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.890277] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.890370] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 46d5cc5f-1ff2-4356-b17c-0a092d6eef11 is going to be updated. [ 1225.914975] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.915153] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.915232] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.915489] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.915627] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.915798] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-46d5cc5f-1ff2-4356-b17c-0a092d6eef11" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.388507] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bb4dda56-d5fb-4d9e-a613-8204b35459b5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.890759] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.890894] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.890973] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.891392] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.891392] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.891392] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb4dda56-d5fb-4d9e-a613-8204b35459b5 is going to be created. [ 1226.920709] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.920825] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.920825] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.921536] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.921536] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.932753] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb4dda56-d5fb-4d9e-a613-8204b35459b5 in Status: UNINITIALIZED for 2s [ 1227.593740] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 in Status: SUCCESS [ 1227.594158] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 deletion is rescheduled due to dependency. [ 1227.594158] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.942578] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb4dda56-d5fb-4d9e-a613-8204b35459b5 in Status: SUCCESS [ 1228.942948] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb4dda56-d5fb-4d9e-a613-8204b35459b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.942948] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb4dda56-d5fb-4d9e-a613-8204b35459b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.943224] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb4dda56-d5fb-4d9e-a613-8204b35459b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.943412] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.943528] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.943592] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.943753] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.943831] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.943915] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb4dda56-d5fb-4d9e-a613-8204b35459b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.944016] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bb4dda56-d5fb-4d9e-a613-8204b35459b5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.446228] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bb4dda56-d5fb-4d9e-a613-8204b35459b5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.948765] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bb4dda56-d5fb-4d9e-a613-8204b35459b5: rpc.has_security_group_logging(os_id): False [ 1229.968942] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.969172] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.969277] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.969518] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.969611] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.969877] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.969981] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.970057] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.970213] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.970292] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.970381] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bb4dda56-d5fb-4d9e-a613-8204b35459b5 is going to be created. [ 1230.056367] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.056611] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.056611] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.056767] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.056941] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.071560] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bb4dda56-d5fb-4d9e-a613-8204b35459b5 in Status: IN_PROGRESS for 2s [ 1230.380462] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1230.380616] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1232.088044] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bb4dda56-d5fb-4d9e-a613-8204b35459b5 in Status: SUCCESS [ 1232.088392] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bb4dda56-d5fb-4d9e-a613-8204b35459b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.151302] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock network-852 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.151634] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "network-852" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.151634] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "network-852" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.152060] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "network-852" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.152306] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.152468] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.152586] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.153021] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.153182] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.153416] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1233.153589] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1233.153716] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1233.153829] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1233.153941] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1233.154177] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1233.154391] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1233.176178] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1233.176326] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1233.176513] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1233.176696] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "network-852" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.176997] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock port-86722419-f128-4418-822d-b0ca677c4cc8 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.177177] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "port-86722419-f128-4418-822d-b0ca677c4cc8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.177294] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "port-86722419-f128-4418-822d-b0ca677c4cc8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.177545] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "port-86722419-f128-4418-822d-b0ca677c4cc8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.177740] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86722419-f128-4418-822d-b0ca677c4cc8',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.679977] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.680259] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.680365] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.680671] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.680827] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.681145] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.681303] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.681418] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.681641] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.681776] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.682066] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.682219] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.682332] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.682542] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.682672] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.682808] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Resource: SegmentPort with ID: 86722419-f128-4418-822d-b0ca677c4cc8 is going to be updated. [ 1233.704422] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.704645] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.704751] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.705058] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.705262] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.705577] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "port-86722419-f128-4418-822d-b0ca677c4cc8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.430932] env[65471]: INFO networking_nsxv3.common.synchronization [req-19896f62-6ecb-4126-a06b-0bb480699112 req-17ab58ff-6ade-4f00-ab31-ec51301439f8 service nova] Enqueued Resource ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 with Priority: HIGHEST for action security_group_rules [ 1234.431216] env[65471]: INFO networking_nsxv3.common.synchronization [req-19896f62-6ecb-4126-a06b-0bb480699112 req-17ab58ff-6ade-4f00-ab31-ec51301439f8 service nova] Enqueued Resource ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 with Priority: HIGHEST for action security_group_members [ 1234.431281] env[65471]: INFO networking_nsxv3.common.synchronization [req-19896f62-6ecb-4126-a06b-0bb480699112 req-17ab58ff-6ade-4f00-ab31-ec51301439f8 service nova] Enqueued Resource ID: 86722419-f128-4418-822d-b0ca677c4cc8 with Priority: HIGHEST for action port [ 1234.431776] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 with Priority: HIGHEST for action security_group_rules [ 1234.431917] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 with Priority: HIGHEST for action security_group_members [ 1234.432191] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86722419-f128-4418-822d-b0ca677c4cc8 with Priority: HIGHEST for action port [ 1234.432523] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b71ce0e0-83fe-4f36-8617-e29f83b0be32 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.432646] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.432737] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.432954] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.433020] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b71ce0e0-83fe-4f36-8617-e29f83b0be32',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.436237] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-b71ce0e0-83fe-4f36-8617-e29f83b0be32 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.436359] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.436427] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.436804] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.437193] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.437346] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.437395] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.437557] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.437646] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.437742] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b71ce0e0-83fe-4f36-8617-e29f83b0be32',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.439082] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-86722419-f128-4418-822d-b0ca677c4cc8 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.439309] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-86722419-f128-4418-822d-b0ca677c4cc8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.439391] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-86722419-f128-4418-822d-b0ca677c4cc8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.439554] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-86722419-f128-4418-822d-b0ca677c4cc8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.439662] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86722419-f128-4418-822d-b0ca677c4cc8',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.937409] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-b71ce0e0-83fe-4f36-8617-e29f83b0be32 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.937589] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.939930] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b71ce0e0-83fe-4f36-8617-e29f83b0be32',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.941875] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 86722419-f128-4418-822d-b0ca677c4cc8 with status ACTIVE [ 1234.942781] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.942781] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.942781] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.942781] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.942781] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.942781] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.942781] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.943167] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.943167] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.943167] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.943538] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.943538] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.943538] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.943538] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.943687] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.943687] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 86722419-f128-4418-822d-b0ca677c4cc8 is going to be updated. [ 1234.970254] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.970380] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.970453] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.970672] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.970811] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.970989] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-86722419-f128-4418-822d-b0ca677c4cc8" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.443067] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b71ce0e0-83fe-4f36-8617-e29f83b0be32',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.946071] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.946265] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.946315] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.946570] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.946676] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.946782] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 is going to be updated. [ 1235.978758] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.978986] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.978986] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.979197] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.979344] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.990716] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 in Status: IN_PROGRESS for 2s [ 1238.002057] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 in Status: SUCCESS [ 1238.002057] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.002057] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.002057] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.002614] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.002614] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.002614] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.002614] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.002614] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.002906] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.002906] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b71ce0e0-83fe-4f36-8617-e29f83b0be32',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.504760] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b71ce0e0-83fe-4f36-8617-e29f83b0be32',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.007950] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b71ce0e0-83fe-4f36-8617-e29f83b0be32: rpc.has_security_group_logging(os_id): False [ 1239.026151] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.026437] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.026437] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.026644] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.026751] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.027127] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.027236] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.027309] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.027481] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.027577] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.027667] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 is going to be updated. [ 1239.088420] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.088658] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.088716] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.088977] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.089147] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.106777] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 in Status: IN_PROGRESS for 2s [ 1239.433166] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1239.433373] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1241.126760] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 in Status: SUCCESS [ 1241.127148] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.434419] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1244.434795] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1247.220867] env[65471]: INFO networking_nsxv3.common.synchronization [req-35553d3d-65db-49b5-b4f7-2cf941f6855f req-0632f280-f91f-4fa3-99d1-16cdd08a0528 tempest-ServerActionsTestOtherA-1623203122 tempest-ServerActionsTestOtherA-1623203122-project-member] Enqueued Resource ID: f7dafcbc-15be-4704-ad92-28657ead70aa with Priority: HIGHEST for action security_group_members [ 1247.221602] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7dafcbc-15be-4704-ad92-28657ead70aa with Priority: HIGHEST for action security_group_members [ 1247.222038] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7dafcbc-15be-4704-ad92-28657ead70aa taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.222222] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.222438] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.222737] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.222827] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.222960] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.223069] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.223281] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.224917] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.224917] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7dafcbc-15be-4704-ad92-28657ead70aa',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.726777] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f7dafcbc-15be-4704-ad92-28657ead70aa',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.229697] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f7dafcbc-15be-4704-ad92-28657ead70aa',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.284743] env[65471]: INFO networking_nsxv3.common.synchronization [req-96e95658-b924-4008-876a-9bb82eaffa8b req-6130c8aa-b53b-4034-9c29-23cd07935c5f tempest-ServersTestFqdnHostnames-2061450103 tempest-ServersTestFqdnHostnames-2061450103-project-member] Enqueued Resource ID: aace9d42-8d1a-4084-977e-6247dec82279 with Priority: HIGHEST for action security_group_members [ 1248.285401] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aace9d42-8d1a-4084-977e-6247dec82279 with Priority: HIGHEST for action security_group_members [ 1248.285700] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-aace9d42-8d1a-4084-977e-6247dec82279 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.285825] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aace9d42-8d1a-4084-977e-6247dec82279" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.285907] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aace9d42-8d1a-4084-977e-6247dec82279" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.286402] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aace9d42-8d1a-4084-977e-6247dec82279" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.286402] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.286523] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.286572] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.286747] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.287892] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.287892] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aace9d42-8d1a-4084-977e-6247dec82279',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.733314] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.733314] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.733555] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.733671] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.733780] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.733907] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7dafcbc-15be-4704-ad92-28657ead70aa is going to be updated. [ 1248.761687] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.761886] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.761886] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.762111] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.762266] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.770552] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7dafcbc-15be-4704-ad92-28657ead70aa in Status: IN_PROGRESS for 2s [ 1248.792109] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.792316] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.792316] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.792539] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.792632] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.792884] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.792991] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.793065] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.793228] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.793305] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.793388] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aace9d42-8d1a-4084-977e-6247dec82279 is going to be updated. [ 1248.823990] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.824230] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.824230] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.824417] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.824552] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.834734] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aace9d42-8d1a-4084-977e-6247dec82279 in Status: IN_PROGRESS for 2s [ 1249.928906] env[65471]: INFO networking_nsxv3.common.synchronization [req-a3907b7a-6c7e-4037-8265-5fa6afb7d363 req-d4c992aa-790e-4416-9f66-0085d79f9975 tempest-ServerActionsTestOtherB-402089456 tempest-ServerActionsTestOtherB-402089456-project-member] Enqueued Resource ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 with Priority: HIGHEST for action security_group_members [ 1249.929327] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 with Priority: HIGHEST for action security_group_members [ 1249.929570] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-b71ce0e0-83fe-4f36-8617-e29f83b0be32 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.929570] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.929654] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.930044] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.930044] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.930197] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.930197] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.930274] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.930355] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.930441] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b71ce0e0-83fe-4f36-8617-e29f83b0be32',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.432830] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.433075] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.433075] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.433246] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.433378] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.433737] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.433737] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.433877] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.433908] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.433989] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.434068] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 is going to be updated. [ 1250.460512] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.460855] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.460855] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.461012] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.461073] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.469661] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 in Status: IN_PROGRESS for 2s [ 1250.779908] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7dafcbc-15be-4704-ad92-28657ead70aa in Status: SUCCESS [ 1250.780241] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.843840] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aace9d42-8d1a-4084-977e-6247dec82279 in Status: SUCCESS [ 1250.844081] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aace9d42-8d1a-4084-977e-6247dec82279 deletion is rescheduled due to dependency. [ 1250.844166] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aace9d42-8d1a-4084-977e-6247dec82279" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.479203] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 in Status: SUCCESS [ 1252.479442] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 deletion is rescheduled due to dependency. [ 1252.479492] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.931166] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1254.931166] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1259.931557] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1259.931557] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1263.759142] env[65471]: INFO networking_nsxv3.common.synchronization [req-df2b22bd-d4c2-4675-9ab7-45ac3da04749 req-d57e4992-58b8-4e99-aab3-c8d0ce0b2b35 tempest-ServerActionsTestOtherA-1623203122 tempest-ServerActionsTestOtherA-1623203122-project-member] Enqueued Resource ID: f7dafcbc-15be-4704-ad92-28657ead70aa with Priority: HIGHEST for action security_group_members [ 1263.759701] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7dafcbc-15be-4704-ad92-28657ead70aa with Priority: HIGHEST for action security_group_members [ 1263.759751] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7dafcbc-15be-4704-ad92-28657ead70aa taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.759879] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.759931] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.760263] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.760426] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.760529] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.760639] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.760770] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.760857] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.760951] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7dafcbc-15be-4704-ad92-28657ead70aa',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.856138] env[65471]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1263.856342] env[65471]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] NSXv3 Agent Agent loop - iteration:3 started [ 1264.264045] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.264045] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.264045] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.264320] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.264320] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.264521] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.264611] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.264674] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.264825] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.264902] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.264997] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7dafcbc-15be-4704-ad92-28657ead70aa is going to be updated. [ 1264.295668] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.295896] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.295955] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.296169] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.296316] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.304319] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7dafcbc-15be-4704-ad92-28657ead70aa in Status: IN_PROGRESS for 2s [ 1266.322904] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7dafcbc-15be-4704-ad92-28657ead70aa in Status: SUCCESS [ 1266.323552] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7dafcbc-15be-4704-ad92-28657ead70aa deletion is rescheduled due to dependency. [ 1266.323552] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.761176] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1268.761487] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1272.942718] env[65471]: INFO networking_nsxv3.common.synchronization [None req-0c445558-b830-4b37-b84a-7feb90f28a48 None None] Enqueued Resource ID: 85fab807-fd8b-4b82-a5b2-3114f529bd45 with Priority: HIGHEST for action port [ 1272.946041] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85fab807-fd8b-4b82-a5b2-3114f529bd45 with Priority: HIGHEST for action port [ 1272.946041] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-85fab807-fd8b-4b82-a5b2-3114f529bd45 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.946041] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-85fab807-fd8b-4b82-a5b2-3114f529bd45" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.946041] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-85fab807-fd8b-4b82-a5b2-3114f529bd45" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.946299] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-85fab807-fd8b-4b82-a5b2-3114f529bd45" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.946402] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85fab807-fd8b-4b82-a5b2-3114f529bd45',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.448609] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 85fab807-fd8b-4b82-a5b2-3114f529bd45 [ 1273.448824] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.448945] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.448989] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.449256] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.449351] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.449416] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:85fab807-fd8b-4b82-a5b2-3114f529bd45 already deleted. [ 1273.449497] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-85fab807-fd8b-4b82-a5b2-3114f529bd45" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.606682] env[65471]: INFO networking_nsxv3.common.synchronization [None req-d7221ca8-0c46-4372-adbc-adc17e49dbb5 tempest-ServerActionsV293TestJSON-1492347165 tempest-ServerActionsV293TestJSON-1492347165-project-member] Enqueued Resource ID: fc59e563-a28d-43a9-a7da-a35d9c5252e5 with Priority: HIGHEST for action security_group_rules [ 1273.607021] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc59e563-a28d-43a9-a7da-a35d9c5252e5 with Priority: HIGHEST for action security_group_rules [ 1273.607332] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fc59e563-a28d-43a9-a7da-a35d9c5252e5 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.607473] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fc59e563-a28d-43a9-a7da-a35d9c5252e5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.607602] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fc59e563-a28d-43a9-a7da-a35d9c5252e5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.607848] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fc59e563-a28d-43a9-a7da-a35d9c5252e5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.607945] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fc59e563-a28d-43a9-a7da-a35d9c5252e5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.691916] env[65471]: INFO networking_nsxv3.common.synchronization [None req-662a4d1b-9eac-4e22-8a9d-a7f01208d487 tempest-ServerActionsV293TestJSON-1492347165 tempest-ServerActionsV293TestJSON-1492347165-project-member] Enqueued Resource ID: fc59e563-a28d-43a9-a7da-a35d9c5252e5 with Priority: HIGHEST for action security_group_rules [ 1273.692396] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc59e563-a28d-43a9-a7da-a35d9c5252e5 with Priority: HIGHEST for action security_group_rules [ 1273.692709] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fc59e563-a28d-43a9-a7da-a35d9c5252e5 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.692803] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fc59e563-a28d-43a9-a7da-a35d9c5252e5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.140527] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.140896] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.140896] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.140969] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.141286] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.141391] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fc59e563-a28d-43a9-a7da-a35d9c5252e5 already deleted. [ 1274.141444] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fc59e563-a28d-43a9-a7da-a35d9c5252e5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.141615] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fc59e563-a28d-43a9-a7da-a35d9c5252e5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.141783] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fc59e563-a28d-43a9-a7da-a35d9c5252e5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.141869] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fc59e563-a28d-43a9-a7da-a35d9c5252e5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.667570] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.667570] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.667570] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.667945] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.667945] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.668148] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fc59e563-a28d-43a9-a7da-a35d9c5252e5 already deleted. [ 1274.668148] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fc59e563-a28d-43a9-a7da-a35d9c5252e5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.109036] env[65471]: INFO networking_nsxv3.common.synchronization [None req-c15b7b5f-d017-4bee-89f9-cfeed71e6ee9 None None] Enqueued Resource ID: 29495f81-af19-42e4-a1f7-61bf5cadb95a with Priority: HIGHEST for action port [ 1275.109416] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29495f81-af19-42e4-a1f7-61bf5cadb95a with Priority: HIGHEST for action port [ 1275.110392] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-29495f81-af19-42e4-a1f7-61bf5cadb95a taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.110556] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-29495f81-af19-42e4-a1f7-61bf5cadb95a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.110642] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-29495f81-af19-42e4-a1f7-61bf5cadb95a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.110989] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-29495f81-af19-42e4-a1f7-61bf5cadb95a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.111098] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('29495f81-af19-42e4-a1f7-61bf5cadb95a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.613879] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 29495f81-af19-42e4-a1f7-61bf5cadb95a [ 1275.614553] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.614655] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.614750] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.614952] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.615133] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.615177] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:29495f81-af19-42e4-a1f7-61bf5cadb95a already deleted. [ 1275.615241] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-29495f81-af19-42e4-a1f7-61bf5cadb95a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.110555] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1280.110913] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1283.265178] env[65471]: INFO networking_nsxv3.common.synchronization [req-28578537-2092-40e7-bbe9-8852de265cd6 req-33f9f4b7-db03-4612-bec9-39f4fb91502b tempest-AttachVolumeNegativeTest-275281664 tempest-AttachVolumeNegativeTest-275281664-project-member] Enqueued Resource ID: 4d21733d-db9f-4e61-bcaf-373b43488925 with Priority: HIGHEST for action security_group_members [ 1283.265721] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d21733d-db9f-4e61-bcaf-373b43488925 with Priority: HIGHEST for action security_group_members [ 1283.266195] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d21733d-db9f-4e61-bcaf-373b43488925 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.266342] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d21733d-db9f-4e61-bcaf-373b43488925" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.266408] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d21733d-db9f-4e61-bcaf-373b43488925" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.266612] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d21733d-db9f-4e61-bcaf-373b43488925" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.266783] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.266941] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.267157] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.267380] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.267526] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.267685] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4d21733d-db9f-4e61-bcaf-373b43488925',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.769938] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.770145] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.770218] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.770467] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.770591] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.770804] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.770904] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.770956] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.771153] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.771219] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.771313] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4d21733d-db9f-4e61-bcaf-373b43488925 is going to be updated. [ 1283.809054] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.809054] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.809054] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.809703] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.809703] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.820024] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4d21733d-db9f-4e61-bcaf-373b43488925 in Status: IN_PROGRESS for 2s [ 1284.808727] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.809193] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.809193] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.809315] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.809375] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.131380] env[65471]: INFO networking_nsxv3.common.synchronization [req-af256927-663f-4887-833f-f9b9ff3d6cdc req-8de642b1-70b5-4abf-8eea-0d4d37842664 tempest-ServerActionsTestJSON-1061383532 tempest-ServerActionsTestJSON-1061383532-project-member] Enqueued Resource ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 with Priority: HIGHEST for action security_group_members [ 1285.131990] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 with Priority: HIGHEST for action security_group_members [ 1285.132351] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-401f7079-c4c2-4951-b6ae-bc1cfbb23228 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.133150] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.133266] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.133475] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.133648] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.133757] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.133821] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.134089] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.134159] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.134224] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('401f7079-c4c2-4951-b6ae-bc1cfbb23228',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.312573] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.637286] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.637468] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.637468] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.637698] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.637813] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.637991] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.638106] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.638171] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.638331] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.638408] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.638494] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 is going to be updated. [ 1285.665531] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.665732] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.665732] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.665971] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.666111] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.676610] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 in Status: IN_PROGRESS for 2s [ 1285.815215] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.830028] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4d21733d-db9f-4e61-bcaf-373b43488925 in Status: SUCCESS [ 1285.830266] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4d21733d-db9f-4e61-bcaf-373b43488925 deletion is rescheduled due to dependency. [ 1285.830379] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d21733d-db9f-4e61-bcaf-373b43488925" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.317790] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1286.317988] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1287.166604] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.166955] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.166955] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.167129] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.179510] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1287.180566] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.181840] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1287.220460] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.220620] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.220692] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.220923] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.234287] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.235072] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1287.235160] env[65471]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65471) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1287.235254] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1287.288236] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.288469] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.288469] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.288617] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.289897] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.290097] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1287.391904] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.392137] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.392245] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.392497] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.392919] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.393306] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1287.477467] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.477669] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.477669] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.477904] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.478283] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.478621] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:42. [ 1287.478737] env[65471]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'6d51d32d-beb9-4c26-b877-a2c1a68caa39', '735019a1-4315-46a6-b3c7-ec71fdc6ef33', '748c6b66-3e73-44a5-8430-c76b55ad8ee3', '8c8d67e4-5b19-43b8-b618-1f0b1d72c71a', 'aace9d42-8d1a-4084-977e-6247dec82279', 'f7dafcbc-15be-4704-ad92-28657ead70aa', '2e3bdef3-6800-4bd2-84b8-3ef120fd62f1', 'ba0eaf1c-cef3-41f3-a334-f5b6dbf38966', '57e97084-a75e-460b-85c9-345b90077d12', '401f7079-c4c2-4951-b6ae-bc1cfbb23228', 'e7122ab9-4313-4173-8869-cf7cd16cccf0', '57387769-3919-42b1-a3d7-3d45bcef516d', 'b71ce0e0-83fe-4f36-8617-e29f83b0be32', '8a168c13-528b-4758-b139-f0aa310cde5c', '2a9f3871-1bad-4130-b669-97b85ced692d', 'c35d5123-3fe1-447f-aedc-8112e5faa2b6', 'dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6', '7cefc497-117e-45da-bc1f-1ab0ea166d74', 'e8869e0a-9385-48b2-ac90-589c8415df21', '69a8cc18-3d2c-4522-9688-4b5525d659e0', '34e45751-3d11-4d8a-ad9f-272d1ad803fe', 'ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46', '14a38584-d8ef-4361-b344-b91e376144fa', 'bbd99ac4-1db4-4ccf-af90-c6ef33212f88', 'a976012d-6558-47ff-8d35-cffeac52b05f', '0c92cf42-7023-4aba-91c3-95f84d379c9f', '76ee3a37-4552-4528-8f6c-448ca2d9b094', 'bb4dda56-d5fb-4d9e-a613-8204b35459b5', '918bf7c8-0ca6-4052-a0a9-38a8db5664ea', '7b0e439e-ae4b-45e5-b678-0ea9b193c6d4', 'ba1a1760-87f6-4927-9e91-698752fe3531', '89cca73a-b121-4b09-8f43-f96b481d6295', '2c8ff43e-9a83-418c-851d-179c01ee77a0', 'a70c8576-d6c6-406f-8ebf-d5fb66c56b95', '4d21733d-db9f-4e61-bcaf-373b43488925', '927a7ac0-117d-4551-a979-a43f61af6c25', '1b605f75-31b8-4209-be69-e1c60e682aa5', '50c2c28e-c8d2-4f9e-a431-6df336da2df5', 'b04574ca-6910-4de6-a76c-d7d90c7e2e0c', '1c8a6eda-c0ec-4e25-8652-6acf3d57da4e', '847d876e-b40b-4d73-9c81-1622676c73b5', '85af6c5e-2f9b-491d-9584-96c44b20f99f'} {{(pid=65471) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1287.478826] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1287.500648] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.500926] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.500926] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.501151] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.501227] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.501364] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1287.501453] env[65471]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65471) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1287.501512] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1287.580811] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.581056] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.581056] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.581236] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.582347] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.582613] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1287.582690] env[65471]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65471) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1287.582762] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1287.582830] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1287.582910] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/42 resources of Type:Security Group Rules [ 1287.582984] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6d51d32d-beb9-4c26-b877-a2c1a68caa39 with Priority: HIGH for action security_group_rules [ 1287.583073] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 with Priority: HIGH for action security_group_rules [ 1287.583140] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 748c6b66-3e73-44a5-8430-c76b55ad8ee3 with Priority: HIGH for action security_group_rules [ 1287.583202] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8c8d67e4-5b19-43b8-b618-1f0b1d72c71a with Priority: HIGH for action security_group_rules [ 1287.583263] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: aace9d42-8d1a-4084-977e-6247dec82279 with Priority: HIGH for action security_group_rules [ 1287.583325] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f7dafcbc-15be-4704-ad92-28657ead70aa with Priority: HIGH for action security_group_rules [ 1287.583386] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2e3bdef3-6800-4bd2-84b8-3ef120fd62f1 with Priority: HIGH for action security_group_rules [ 1287.583447] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ba0eaf1c-cef3-41f3-a334-f5b6dbf38966 with Priority: HIGH for action security_group_rules [ 1287.583507] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 57e97084-a75e-460b-85c9-345b90077d12 with Priority: HIGH for action security_group_rules [ 1287.583569] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 with Priority: HIGH for action security_group_rules [ 1287.583629] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e7122ab9-4313-4173-8869-cf7cd16cccf0 with Priority: HIGH for action security_group_rules [ 1287.583688] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 57387769-3919-42b1-a3d7-3d45bcef516d with Priority: HIGH for action security_group_rules [ 1287.583749] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 with Priority: HIGH for action security_group_rules [ 1287.583808] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8a168c13-528b-4758-b139-f0aa310cde5c with Priority: HIGH for action security_group_rules [ 1287.583868] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2a9f3871-1bad-4130-b669-97b85ced692d with Priority: HIGH for action security_group_rules [ 1287.583941] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 with Priority: HIGH for action security_group_rules [ 1287.584011] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6 with Priority: HIGH for action security_group_rules [ 1287.584094] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7cefc497-117e-45da-bc1f-1ab0ea166d74 with Priority: HIGH for action security_group_rules [ 1287.584146] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e8869e0a-9385-48b2-ac90-589c8415df21 with Priority: HIGH for action security_group_rules [ 1287.584190] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 69a8cc18-3d2c-4522-9688-4b5525d659e0 with Priority: HIGH for action security_group_rules [ 1287.584281] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.686518] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 in Status: SUCCESS [ 1287.686754] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 deletion is rescheduled due to dependency. [ 1287.686872] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.132991] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1290.133280] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1290.133280] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d51d32d-beb9-4c26-b877-a2c1a68caa39 with Priority: HIGH for action security_group_rules [ 1290.133384] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 748c6b66-3e73-44a5-8430-c76b55ad8ee3 with Priority: HIGH for action security_group_rules [ 1290.133525] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e3bdef3-6800-4bd2-84b8-3ef120fd62f1 with Priority: HIGH for action security_group_rules [ 1290.133690] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a9f3871-1bad-4130-b669-97b85ced692d with Priority: HIGH for action security_group_rules [ 1290.133855] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69a8cc18-3d2c-4522-9688-4b5525d659e0 with Priority: HIGH for action security_group_rules [ 1290.133937] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8869e0a-9385-48b2-ac90-589c8415df21 with Priority: HIGH for action security_group_rules [ 1290.134071] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cefc497-117e-45da-bc1f-1ab0ea166d74 with Priority: HIGH for action security_group_rules [ 1290.134279] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6 with Priority: HIGH for action security_group_rules [ 1290.134313] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a168c13-528b-4758-b139-f0aa310cde5c with Priority: HIGH for action security_group_rules [ 1290.134401] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 with Priority: HIGH for action security_group_rules [ 1290.134506] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 with Priority: HIGH for action security_group_rules [ 1290.134631] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57387769-3919-42b1-a3d7-3d45bcef516d with Priority: HIGH for action security_group_rules [ 1290.134750] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7122ab9-4313-4173-8869-cf7cd16cccf0 with Priority: HIGH for action security_group_rules [ 1290.134867] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 with Priority: HIGH for action security_group_rules [ 1290.134981] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57e97084-a75e-460b-85c9-345b90077d12 with Priority: HIGH for action security_group_rules [ 1290.135116] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7dafcbc-15be-4704-ad92-28657ead70aa with Priority: HIGH for action security_group_rules [ 1290.135232] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba0eaf1c-cef3-41f3-a334-f5b6dbf38966 with Priority: HIGH for action security_group_rules [ 1290.135348] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aace9d42-8d1a-4084-977e-6247dec82279 with Priority: HIGH for action security_group_rules [ 1290.135463] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 with Priority: HIGH for action security_group_rules [ 1290.135583] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c8d67e4-5b19-43b8-b618-1f0b1d72c71a with Priority: HIGH for action security_group_rules [ 1290.136095] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d51d32d-beb9-4c26-b877-a2c1a68caa39 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.136304] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d51d32d-beb9-4c26-b877-a2c1a68caa39" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.136376] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d51d32d-beb9-4c26-b877-a2c1a68caa39" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.136631] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d51d32d-beb9-4c26-b877-a2c1a68caa39" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.136740] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d51d32d-beb9-4c26-b877-a2c1a68caa39',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.137826] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-748c6b66-3e73-44a5-8430-c76b55ad8ee3 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.137945] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-748c6b66-3e73-44a5-8430-c76b55ad8ee3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.138038] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-748c6b66-3e73-44a5-8430-c76b55ad8ee3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.138223] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-748c6b66-3e73-44a5-8430-c76b55ad8ee3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.138296] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('748c6b66-3e73-44a5-8430-c76b55ad8ee3',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.139430] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.139547] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.139605] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.139750] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.139825] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2e3bdef3-6800-4bd2-84b8-3ef120fd62f1',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.141933] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2a9f3871-1bad-4130-b669-97b85ced692d taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.141933] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2a9f3871-1bad-4130-b669-97b85ced692d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.141933] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2a9f3871-1bad-4130-b669-97b85ced692d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.142077] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2a9f3871-1bad-4130-b669-97b85ced692d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.142107] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2a9f3871-1bad-4130-b669-97b85ced692d',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.143754] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69a8cc18-3d2c-4522-9688-4b5525d659e0 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.143754] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69a8cc18-3d2c-4522-9688-4b5525d659e0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.143754] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69a8cc18-3d2c-4522-9688-4b5525d659e0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.143754] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69a8cc18-3d2c-4522-9688-4b5525d659e0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.143754] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69a8cc18-3d2c-4522-9688-4b5525d659e0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.144697] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e8869e0a-9385-48b2-ac90-589c8415df21 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.144697] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.144790] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.145307] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.145344] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e8869e0a-9385-48b2-ac90-589c8415df21',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.146570] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7cefc497-117e-45da-bc1f-1ab0ea166d74 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.146680] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.146746] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.146898] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.146986] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7cefc497-117e-45da-bc1f-1ab0ea166d74',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.148324] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.148446] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.148494] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.149028] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.149028] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.149814] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a168c13-528b-4758-b139-f0aa310cde5c taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.149928] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a168c13-528b-4758-b139-f0aa310cde5c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.149996] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a168c13-528b-4758-b139-f0aa310cde5c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.150159] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a168c13-528b-4758-b139-f0aa310cde5c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.150234] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a168c13-528b-4758-b139-f0aa310cde5c',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.150932] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c35d5123-3fe1-447f-aedc-8112e5faa2b6 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.151049] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.151114] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.151334] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.151334] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c35d5123-3fe1-447f-aedc-8112e5faa2b6',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.152010] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b71ce0e0-83fe-4f36-8617-e29f83b0be32 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.152127] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.152192] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.152335] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.152406] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b71ce0e0-83fe-4f36-8617-e29f83b0be32',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.154075] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57387769-3919-42b1-a3d7-3d45bcef516d taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.154188] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57387769-3919-42b1-a3d7-3d45bcef516d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.154245] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57387769-3919-42b1-a3d7-3d45bcef516d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.154407] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57387769-3919-42b1-a3d7-3d45bcef516d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.154483] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57387769-3919-42b1-a3d7-3d45bcef516d',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.155765] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e7122ab9-4313-4173-8869-cf7cd16cccf0 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.155929] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e7122ab9-4313-4173-8869-cf7cd16cccf0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.156063] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e7122ab9-4313-4173-8869-cf7cd16cccf0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.156230] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e7122ab9-4313-4173-8869-cf7cd16cccf0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.156305] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e7122ab9-4313-4173-8869-cf7cd16cccf0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.157192] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-401f7079-c4c2-4951-b6ae-bc1cfbb23228 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.157298] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.157365] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.157510] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.157604] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('401f7079-c4c2-4951-b6ae-bc1cfbb23228',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.159270] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57e97084-a75e-460b-85c9-345b90077d12 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.159371] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57e97084-a75e-460b-85c9-345b90077d12" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.159431] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57e97084-a75e-460b-85c9-345b90077d12" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.159579] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57e97084-a75e-460b-85c9-345b90077d12" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.159990] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57e97084-a75e-460b-85c9-345b90077d12',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.161387] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7dafcbc-15be-4704-ad92-28657ead70aa taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.161484] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.161547] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.161698] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.161825] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7dafcbc-15be-4704-ad92-28657ead70aa',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.162502] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ba0eaf1c-cef3-41f3-a334-f5b6dbf38966 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.162611] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ba0eaf1c-cef3-41f3-a334-f5b6dbf38966" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.162677] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ba0eaf1c-cef3-41f3-a334-f5b6dbf38966" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.162820] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ba0eaf1c-cef3-41f3-a334-f5b6dbf38966" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.162884] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ba0eaf1c-cef3-41f3-a334-f5b6dbf38966',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.163615] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aace9d42-8d1a-4084-977e-6247dec82279 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.163674] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aace9d42-8d1a-4084-977e-6247dec82279" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.163706] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aace9d42-8d1a-4084-977e-6247dec82279" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.163844] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aace9d42-8d1a-4084-977e-6247dec82279" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.163917] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aace9d42-8d1a-4084-977e-6247dec82279',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.164576] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-735019a1-4315-46a6-b3c7-ec71fdc6ef33 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.164675] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.164760] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.164875] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.164947] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('735019a1-4315-46a6-b3c7-ec71fdc6ef33',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.165739] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c8d67e4-5b19-43b8-b618-1f0b1d72c71a taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.165839] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c8d67e4-5b19-43b8-b618-1f0b1d72c71a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.165896] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c8d67e4-5b19-43b8-b618-1f0b1d72c71a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.166889] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c8d67e4-5b19-43b8-b618-1f0b1d72c71a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.167126] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c8d67e4-5b19-43b8-b618-1f0b1d72c71a',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.194264] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.194405] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.194506] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.194681] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.215221] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.215372] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2e3bdef3-6800-4bd2-84b8-3ef120fd62f1 is going to be deleted. [ 1290.271457] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.271696] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.271831] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.272164] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.272332] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.272497] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2e3bdef3-6800-4bd2-84b8-3ef120fd62f1" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.692924] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.693190] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.693190] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.693361] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.701360] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.701578] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.702598] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.702698] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.704031] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.704144] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.741172] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.741172] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.742029] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.742151] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.744150] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.744261] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.745074] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.745187] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.745870] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.745960] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.746695] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.746788] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.747621] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.747734] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.748332] env[65471]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1290.748794] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.748878] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.749514] env[65471]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1290.749931] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.750037] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.750644] env[65471]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1290.751058] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.751162] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.751783] env[65471]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1290.752224] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.752333] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.752932] env[65471]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1290.753367] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.753450] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.754131] env[65471]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1290.754528] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.754619] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.755238] env[65471]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1290.755701] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.755828] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69a8cc18-3d2c-4522-9688-4b5525d659e0 is going to be deleted. [ 1290.756832] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.757063] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.762399] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.762544] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.765080] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.765187] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.790948] env[65471]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1290.791332] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.791451] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e8869e0a-9385-48b2-ac90-589c8415df21 is going to be deleted. [ 1290.792700] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.793038] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.950912] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.951354] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b71ce0e0-83fe-4f36-8617-e29f83b0be32 is going to be deleted. [ 1290.952339] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.952621] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.974785] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.974990] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.976911] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.977127] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57387769-3919-42b1-a3d7-3d45bcef516d is going to be deleted. [ 1290.978218] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.978446] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.020999] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.021391] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 401f7079-c4c2-4951-b6ae-bc1cfbb23228 is going to be deleted. [ 1291.022668] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.022948] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.036468] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.036664] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.044870] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.045085] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.073340] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.073514] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7cefc497-117e-45da-bc1f-1ab0ea166d74 is going to be deleted. [ 1291.074716] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.075041] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.142496] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.142865] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6 is going to be deleted. [ 1291.143599] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.143824] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.174490] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.174736] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.198114] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.198291] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c8d67e4-5b19-43b8-b618-1f0b1d72c71a is going to be deleted. [ 1291.199225] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.199639] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.210752] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.210958] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.233472] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.233680] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.268262] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.268489] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 748c6b66-3e73-44a5-8430-c76b55ad8ee3 is going to be deleted. [ 1291.269771] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.270788] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.287410] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.287707] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.372988] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.373279] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 735019a1-4315-46a6-b3c7-ec71fdc6ef33 is going to be deleted. [ 1291.374614] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.374948] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.455981] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.456297] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.477913] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.478080] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d51d32d-beb9-4c26-b877-a2c1a68caa39 is going to be deleted. [ 1291.479041] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.479273] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.499269] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.499567] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.581967] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.582140] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e7122ab9-4313-4173-8869-cf7cd16cccf0 is going to be deleted. [ 1291.583142] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.583441] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.588902] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.589120] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.655566] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.655720] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2a9f3871-1bad-4130-b669-97b85ced692d is going to be deleted. [ 1291.656695] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.656911] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.728840] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.729047] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.739895] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.740070] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aace9d42-8d1a-4084-977e-6247dec82279 is going to be deleted. [ 1291.741145] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.741384] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.859979] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.860137] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a168c13-528b-4758-b139-f0aa310cde5c is going to be deleted. [ 1291.861091] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.861370] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.897487] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.897688] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.898372] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.898496] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.978141] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.978141] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c35d5123-3fe1-447f-aedc-8112e5faa2b6 is going to be deleted. [ 1291.978141] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.978394] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.016405] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.016679] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.057440] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.057671] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.102660] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.102660] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ba0eaf1c-cef3-41f3-a334-f5b6dbf38966 is going to be deleted. [ 1292.103550] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.103783] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.203579] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.203873] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57e97084-a75e-460b-85c9-345b90077d12 is going to be deleted. [ 1292.204697] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.204942] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.210139] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.210321] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.281617] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.281839] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7dafcbc-15be-4704-ad92-28657ead70aa is going to be deleted. [ 1292.283588] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.284009] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.284224] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.284437] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69a8cc18-3d2c-4522-9688-4b5525d659e0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.284617] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.284806] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.284906] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.285136] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e8869e0a-9385-48b2-ac90-589c8415df21" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.285718] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.286032] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.286032] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.286216] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b71ce0e0-83fe-4f36-8617-e29f83b0be32" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.286310] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.287443] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.287443] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.287443] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57387769-3919-42b1-a3d7-3d45bcef516d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.287443] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.287443] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.287443] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.287443] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-401f7079-c4c2-4951-b6ae-bc1cfbb23228" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.287443] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.288263] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.288263] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.288263] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7cefc497-117e-45da-bc1f-1ab0ea166d74" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.288263] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.288972] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.288972] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.288972] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dc5ad059-f1c5-4d9e-a8c3-7c5a884138d6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.289237] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.289351] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.289768] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.289768] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c8d67e4-5b19-43b8-b618-1f0b1d72c71a" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.289768] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.289986] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.291156] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.291156] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-748c6b66-3e73-44a5-8430-c76b55ad8ee3" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.291156] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.291156] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.291156] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.291156] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-735019a1-4315-46a6-b3c7-ec71fdc6ef33" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.291360] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.291484] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.291685] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.291836] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d51d32d-beb9-4c26-b877-a2c1a68caa39" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.292071] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.292317] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.292465] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.292656] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2a9f3871-1bad-4130-b669-97b85ced692d" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.292816] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.292987] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.293098] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.293235] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e7122ab9-4313-4173-8869-cf7cd16cccf0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.293387] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.293533] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.293614] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.293727] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aace9d42-8d1a-4084-977e-6247dec82279" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.293855] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.295219] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.295219] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.295219] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a168c13-528b-4758-b139-f0aa310cde5c" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.295219] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.295219] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.295219] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.295219] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c35d5123-3fe1-447f-aedc-8112e5faa2b6" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.298560] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.298560] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.298560] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.298560] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.298560] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.298560] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ba0eaf1c-cef3-41f3-a334-f5b6dbf38966" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.329117] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.329117] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.329117] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.329117] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.329117] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.329117] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57e97084-a75e-460b-85c9-345b90077d12" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.410952] env[65471]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1292.411832] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.411832] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.412019] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.412278] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.412406] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.412634] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7dafcbc-15be-4704-ad92-28657ead70aa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.658325] env[65471]: INFO networking_nsxv3.common.synchronization [None req-dc9facff-303a-4fb2-bd86-7fd7c7158234 None None] Enqueued Resource ID: 23ed4815-0b0c-47cd-bff8-8c3cfeccd9ba with Priority: HIGHEST for action port [ 1294.658325] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23ed4815-0b0c-47cd-bff8-8c3cfeccd9ba with Priority: HIGHEST for action port [ 1294.658325] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-23ed4815-0b0c-47cd-bff8-8c3cfeccd9ba taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.658325] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23ed4815-0b0c-47cd-bff8-8c3cfeccd9ba" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.658325] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23ed4815-0b0c-47cd-bff8-8c3cfeccd9ba" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.658325] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23ed4815-0b0c-47cd-bff8-8c3cfeccd9ba" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.658325] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23ed4815-0b0c-47cd-bff8-8c3cfeccd9ba',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.162177] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 23ed4815-0b0c-47cd-bff8-8c3cfeccd9ba [ 1295.162177] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.162177] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.162177] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.162394] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.162459] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.162559] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:23ed4815-0b0c-47cd-bff8-8c3cfeccd9ba already deleted. [ 1295.162636] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23ed4815-0b0c-47cd-bff8-8c3cfeccd9ba" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.831951] env[65471]: INFO networking_nsxv3.common.synchronization [None req-48c8f677-e2aa-4185-9132-0c9ef15bc8fc None None] Enqueued Resource ID: 73f1058e-02c6-4e97-8d4f-f4b368ebf5bf with Priority: HIGHEST for action port [ 1296.832516] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73f1058e-02c6-4e97-8d4f-f4b368ebf5bf with Priority: HIGHEST for action port [ 1296.832832] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-73f1058e-02c6-4e97-8d4f-f4b368ebf5bf taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.832958] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-73f1058e-02c6-4e97-8d4f-f4b368ebf5bf" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.833037] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-73f1058e-02c6-4e97-8d4f-f4b368ebf5bf" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.833296] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-73f1058e-02c6-4e97-8d4f-f4b368ebf5bf" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.833377] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73f1058e-02c6-4e97-8d4f-f4b368ebf5bf',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.335778] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 73f1058e-02c6-4e97-8d4f-f4b368ebf5bf [ 1297.336123] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.336282] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.336360] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.336623] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.336737] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.336858] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:73f1058e-02c6-4e97-8d4f-f4b368ebf5bf already deleted. [ 1297.336962] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-73f1058e-02c6-4e97-8d4f-f4b368ebf5bf" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.466852] env[65471]: INFO networking_nsxv3.common.synchronization [req-790b00f8-d4e9-4150-85c1-7719fda965ba req-fb93abf7-4214-4e48-ab26-b5ccb6a9bc7a tempest-ServerActionsV293TestJSON-1492347165 tempest-ServerActionsV293TestJSON-1492347165-project-member] Enqueued Resource ID: fc59e563-a28d-43a9-a7da-a35d9c5252e5 with Priority: HIGHEST for action security_group_members [ 1298.467697] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc59e563-a28d-43a9-a7da-a35d9c5252e5 with Priority: HIGHEST for action security_group_members [ 1298.468112] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc59e563-a28d-43a9-a7da-a35d9c5252e5 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.468279] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc59e563-a28d-43a9-a7da-a35d9c5252e5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.468355] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc59e563-a28d-43a9-a7da-a35d9c5252e5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.468612] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc59e563-a28d-43a9-a7da-a35d9c5252e5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.468772] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.468895] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.468973] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.469348] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.469348] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.469348] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc59e563-a28d-43a9-a7da-a35d9c5252e5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.826933] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock network-978 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.827250] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "network-978" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.827549] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "network-978" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.828640] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "network-978" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.828640] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.828640] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.828640] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.828910] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.828998] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.829232] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1298.830072] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1298.830072] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1298.830072] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1298.830072] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1298.830072] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1298.830072] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1298.850878] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1298.850985] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1298.851463] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1298.851463] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "network-978" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.851746] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock port-bd6e6712-041d-4448-a782-f887024ec737 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.851819] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "port-bd6e6712-041d-4448-a782-f887024ec737" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.851901] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "port-bd6e6712-041d-4448-a782-f887024ec737" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.852228] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "port-bd6e6712-041d-4448-a782-f887024ec737" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.852641] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd6e6712-041d-4448-a782-f887024ec737',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.971501] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.971678] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.971719] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.971959] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.972066] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.972886] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.972886] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.972886] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.972886] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.972886] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.972886] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc59e563-a28d-43a9-a7da-a35d9c5252e5 already deleted. [ 1298.972886] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc59e563-a28d-43a9-a7da-a35d9c5252e5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.355912] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.356170] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.356307] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.356600] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.356748] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.356901] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Segment Port bd6e6712-041d-4448-a782-f887024ec737 not found, creating... [ 1299.357189] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.357348] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.357466] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.357690] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.357825] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.358116] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.358270] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.358395] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.358622] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.358755] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.358892] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Resource: SegmentPort with ID: bd6e6712-041d-4448-a782-f887024ec737 is going to be created. [ 1299.392029] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.392267] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.392375] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.392682] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.392914] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.393153] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "port-bd6e6712-041d-4448-a782-f887024ec737" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.962015] env[65471]: INFO networking_nsxv3.common.synchronization [req-f99df024-5230-4ecf-8e53-40967a3e28f8 req-47c44f5c-95ae-4e74-8466-91e0207553a0 tempest-AttachVolumeTestJSON-782575626 tempest-AttachVolumeTestJSON-782575626-project-member] Enqueued Resource ID: bb4dda56-d5fb-4d9e-a613-8204b35459b5 with Priority: HIGHEST for action security_group_members [ 1299.962303] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb4dda56-d5fb-4d9e-a613-8204b35459b5 with Priority: HIGHEST for action security_group_members [ 1299.963803] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb4dda56-d5fb-4d9e-a613-8204b35459b5 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.963803] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb4dda56-d5fb-4d9e-a613-8204b35459b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.963803] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb4dda56-d5fb-4d9e-a613-8204b35459b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.963803] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb4dda56-d5fb-4d9e-a613-8204b35459b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.963803] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.963803] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.963803] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.963803] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.964528] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.964528] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb4dda56-d5fb-4d9e-a613-8204b35459b5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.134596] env[65471]: INFO networking_nsxv3.common.synchronization [req-790b00f8-d4e9-4150-85c1-7719fda965ba req-48040546-2001-4b79-ad77-092eb989e561 service nova] Enqueued Resource ID: fc59e563-a28d-43a9-a7da-a35d9c5252e5 with Priority: HIGHEST for action security_group_rules [ 1300.136402] env[65471]: INFO networking_nsxv3.common.synchronization [req-790b00f8-d4e9-4150-85c1-7719fda965ba req-48040546-2001-4b79-ad77-092eb989e561 service nova] Enqueued Resource ID: fc59e563-a28d-43a9-a7da-a35d9c5252e5 with Priority: HIGHEST for action security_group_members [ 1300.136706] env[65471]: INFO networking_nsxv3.common.synchronization [req-790b00f8-d4e9-4150-85c1-7719fda965ba req-48040546-2001-4b79-ad77-092eb989e561 service nova] Enqueued Resource ID: bd6e6712-041d-4448-a782-f887024ec737 with Priority: HIGHEST for action port [ 1300.138957] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc59e563-a28d-43a9-a7da-a35d9c5252e5 with Priority: HIGHEST for action security_group_rules [ 1300.138957] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc59e563-a28d-43a9-a7da-a35d9c5252e5 with Priority: HIGHEST for action security_group_members [ 1300.138957] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd6e6712-041d-4448-a782-f887024ec737 with Priority: HIGHEST for action port [ 1300.138957] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fc59e563-a28d-43a9-a7da-a35d9c5252e5 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.138957] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fc59e563-a28d-43a9-a7da-a35d9c5252e5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.138957] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fc59e563-a28d-43a9-a7da-a35d9c5252e5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.139251] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fc59e563-a28d-43a9-a7da-a35d9c5252e5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.139251] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fc59e563-a28d-43a9-a7da-a35d9c5252e5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.140394] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc59e563-a28d-43a9-a7da-a35d9c5252e5 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.140484] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc59e563-a28d-43a9-a7da-a35d9c5252e5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.140612] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc59e563-a28d-43a9-a7da-a35d9c5252e5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.140856] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc59e563-a28d-43a9-a7da-a35d9c5252e5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.141136] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.141382] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.141382] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.142503] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.142503] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.142503] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc59e563-a28d-43a9-a7da-a35d9c5252e5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.142503] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-bd6e6712-041d-4448-a782-f887024ec737 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.142774] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bd6e6712-041d-4448-a782-f887024ec737" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.142774] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bd6e6712-041d-4448-a782-f887024ec737" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.142774] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bd6e6712-041d-4448-a782-f887024ec737" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.142917] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd6e6712-041d-4448-a782-f887024ec737',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.466833] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.467048] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.467145] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.467372] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.489371] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.489626] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.489754] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.489816] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.490037] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.490155] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.490240] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb4dda56-d5fb-4d9e-a613-8204b35459b5 is going to be updated. [ 1300.520875] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.521165] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.521165] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.521419] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.521729] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.532279] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb4dda56-d5fb-4d9e-a613-8204b35459b5 in Status: IN_PROGRESS for 2s [ 1300.594505] env[65471]: INFO networking_nsxv3.common.synchronization [req-f45bdc84-77f3-4313-a770-10e0a589dc20 req-5df9c0b2-339a-4d2c-8e8c-e3a4d70d01be tempest-ServersNegativeTestJSON-1797710450 tempest-ServersNegativeTestJSON-1797710450-project-member] Enqueued Resource ID: 386d020a-c7a5-439c-82eb-884ea70b97b5 with Priority: HIGHEST for action security_group_members [ 1300.595098] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 386d020a-c7a5-439c-82eb-884ea70b97b5 with Priority: HIGHEST for action security_group_members [ 1300.595416] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-386d020a-c7a5-439c-82eb-884ea70b97b5 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.595530] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.595601] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.595859] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.596027] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.596169] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.596277] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.596385] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.596469] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.596564] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('386d020a-c7a5-439c-82eb-884ea70b97b5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.647137] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc59e563-a28d-43a9-a7da-a35d9c5252e5 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.647137] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc59e563-a28d-43a9-a7da-a35d9c5252e5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.647137] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fc59e563-a28d-43a9-a7da-a35d9c5252e5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.647137] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bd6e6712-041d-4448-a782-f887024ec737 with status ACTIVE [ 1300.647137] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.647137] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.647137] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.647828] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.647828] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.647828] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.647828] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.647828] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.648295] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.648295] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.648295] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.648295] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.648496] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.648496] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.648556] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.648710] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bd6e6712-041d-4448-a782-f887024ec737 is going to be updated. [ 1300.677227] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.677227] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.677227] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.677227] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.677227] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.677227] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bd6e6712-041d-4448-a782-f887024ec737" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.920391] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock network-197 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.920589] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "network-197" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.920713] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "network-197" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.921057] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "network-197" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.921320] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.921479] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.921593] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.921804] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.921947] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.922155] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1300.922264] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1300.922368] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1300.922471] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1300.922586] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1300.922687] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1300.922810] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1300.944068] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1300.944290] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1300.944428] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1300.944600] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "network-197" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.944907] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock port-3bef2f34-a1fb-48d0-bc78-dadbc9da2f06 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.945086] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "port-3bef2f34-a1fb-48d0-bc78-dadbc9da2f06" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.945205] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "port-3bef2f34-a1fb-48d0-bc78-dadbc9da2f06" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.945545] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "port-3bef2f34-a1fb-48d0-bc78-dadbc9da2f06" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.945679] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3bef2f34-a1fb-48d0-bc78-dadbc9da2f06',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.099039] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.099460] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.099460] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.099579] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.099634] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.099803] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.099896] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.099960] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.100118] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.100193] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.100275] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 386d020a-c7a5-439c-82eb-884ea70b97b5 already deleted. [ 1301.100354] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.150417] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fc59e563-a28d-43a9-a7da-a35d9c5252e5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.448939] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.448939] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.449220] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.449355] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.449528] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.449687] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Segment Port 3bef2f34-a1fb-48d0-bc78-dadbc9da2f06 not found, creating... [ 1301.449958] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.450129] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.450248] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.450480] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.450633] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.450925] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.451082] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.451208] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.451442] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.451570] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.451708] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Resource: SegmentPort with ID: 3bef2f34-a1fb-48d0-bc78-dadbc9da2f06 is going to be created. [ 1301.472280] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.472505] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.472628] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.473091] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.473409] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.473459] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "port-3bef2f34-a1fb-48d0-bc78-dadbc9da2f06" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.653113] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.653348] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.653348] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.653554] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.653647] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.653751] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc59e563-a28d-43a9-a7da-a35d9c5252e5 is going to be created. [ 1301.681927] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.682162] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.682162] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.682375] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.682538] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.692820] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc59e563-a28d-43a9-a7da-a35d9c5252e5 in Status: UNINITIALIZED for 2s [ 1302.178644] env[65471]: INFO networking_nsxv3.common.synchronization [req-f45bdc84-77f3-4313-a770-10e0a589dc20 req-408da436-3dca-411d-9ffc-ea1d03aac8b2 service nova] Enqueued Resource ID: 386d020a-c7a5-439c-82eb-884ea70b97b5 with Priority: HIGHEST for action security_group_rules [ 1302.178887] env[65471]: INFO networking_nsxv3.common.synchronization [req-f45bdc84-77f3-4313-a770-10e0a589dc20 req-408da436-3dca-411d-9ffc-ea1d03aac8b2 service nova] Enqueued Resource ID: 386d020a-c7a5-439c-82eb-884ea70b97b5 with Priority: HIGHEST for action security_group_members [ 1302.178984] env[65471]: INFO networking_nsxv3.common.synchronization [req-f45bdc84-77f3-4313-a770-10e0a589dc20 req-408da436-3dca-411d-9ffc-ea1d03aac8b2 service nova] Enqueued Resource ID: 3bef2f34-a1fb-48d0-bc78-dadbc9da2f06 with Priority: HIGHEST for action port [ 1302.179651] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 386d020a-c7a5-439c-82eb-884ea70b97b5 with Priority: HIGHEST for action security_group_rules [ 1302.182688] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 386d020a-c7a5-439c-82eb-884ea70b97b5 with Priority: HIGHEST for action security_group_members [ 1302.182688] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bef2f34-a1fb-48d0-bc78-dadbc9da2f06 with Priority: HIGHEST for action port [ 1302.182825] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-386d020a-c7a5-439c-82eb-884ea70b97b5 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.182983] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.183184] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.183353] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.183463] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('386d020a-c7a5-439c-82eb-884ea70b97b5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.184874] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-386d020a-c7a5-439c-82eb-884ea70b97b5 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.184998] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.185079] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.185267] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.185488] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.185593] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.185657] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.185867] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.186689] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.186805] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('386d020a-c7a5-439c-82eb-884ea70b97b5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.191134] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-3bef2f34-a1fb-48d0-bc78-dadbc9da2f06 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.191134] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3bef2f34-a1fb-48d0-bc78-dadbc9da2f06" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.191134] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3bef2f34-a1fb-48d0-bc78-dadbc9da2f06" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.191134] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3bef2f34-a1fb-48d0-bc78-dadbc9da2f06" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.191134] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3bef2f34-a1fb-48d0-bc78-dadbc9da2f06',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.543782] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb4dda56-d5fb-4d9e-a613-8204b35459b5 in Status: SUCCESS [ 1302.543959] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb4dda56-d5fb-4d9e-a613-8204b35459b5 deletion is rescheduled due to dependency. [ 1302.543959] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb4dda56-d5fb-4d9e-a613-8204b35459b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.691030] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('386d020a-c7a5-439c-82eb-884ea70b97b5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.692542] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-386d020a-c7a5-439c-82eb-884ea70b97b5 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.692673] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.692873] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3bef2f34-a1fb-48d0-bc78-dadbc9da2f06 with status ACTIVE [ 1302.693031] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.693148] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.693203] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.693410] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.693498] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.693701] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.693751] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.693820] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.693945] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.694030] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.694257] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.694373] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.694425] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.694537] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.694656] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.694707] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3bef2f34-a1fb-48d0-bc78-dadbc9da2f06 is going to be updated. [ 1302.718071] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.718071] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.718333] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.718370] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.718528] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.718689] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3bef2f34-a1fb-48d0-bc78-dadbc9da2f06" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.193895] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('386d020a-c7a5-439c-82eb-884ea70b97b5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.696842] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.697071] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.697139] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.697409] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.697549] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.697688] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 386d020a-c7a5-439c-82eb-884ea70b97b5 is going to be created. [ 1303.707833] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc59e563-a28d-43a9-a7da-a35d9c5252e5 in Status: SUCCESS [ 1303.708077] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc59e563-a28d-43a9-a7da-a35d9c5252e5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.708266] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc59e563-a28d-43a9-a7da-a35d9c5252e5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.708612] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc59e563-a28d-43a9-a7da-a35d9c5252e5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.708819] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.708935] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.709014] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.709182] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.709268] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.709357] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc59e563-a28d-43a9-a7da-a35d9c5252e5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.709449] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fc59e563-a28d-43a9-a7da-a35d9c5252e5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.725041] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.725201] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.725242] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.725683] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.725865] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.738602] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 386d020a-c7a5-439c-82eb-884ea70b97b5 in Status: UNINITIALIZED for 2s [ 1304.211922] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fc59e563-a28d-43a9-a7da-a35d9c5252e5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.716290] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fc59e563-a28d-43a9-a7da-a35d9c5252e5: rpc.has_security_group_logging(os_id): False [ 1304.736635] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.737041] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.737041] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.737732] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.737732] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.737732] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.737732] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.737732] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.738012] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.738012] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.738118] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fc59e563-a28d-43a9-a7da-a35d9c5252e5 is going to be created. [ 1304.814334] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.814571] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.814571] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.815060] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.815060] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.830980] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc59e563-a28d-43a9-a7da-a35d9c5252e5 in Status: IN_PROGRESS for 2s [ 1305.751209] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 386d020a-c7a5-439c-82eb-884ea70b97b5 in Status: SUCCESS [ 1305.751604] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.751604] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.751834] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.752048] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.752172] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.752240] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.752398] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.752481] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.752568] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.752661] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('386d020a-c7a5-439c-82eb-884ea70b97b5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.255521] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-386d020a-c7a5-439c-82eb-884ea70b97b5 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.255835] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.255835] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.256054] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.256325] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.256497] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.256594] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.256814] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.256937] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.257057] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.257255] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-386d020a-c7a5-439c-82eb-884ea70b97b5 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.257360] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.257416] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.257564] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.257737] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.257863] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.257948] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.258122] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.258205] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.258302] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.258432] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('386d020a-c7a5-439c-82eb-884ea70b97b5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.760593] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 386d020a-c7a5-439c-82eb-884ea70b97b5: rpc.has_security_group_logging(os_id): False [ 1306.778859] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.779132] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.779132] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.779305] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.779396] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.779617] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.779715] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.779773] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.779923] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.779997] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.780194] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.780286] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.780357] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.780494] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.780567] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.780738] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.780827] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.780885] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.781032] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.781105] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.781187] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 386d020a-c7a5-439c-82eb-884ea70b97b5 is going to be created. [ 1306.847240] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc59e563-a28d-43a9-a7da-a35d9c5252e5 in Status: SUCCESS [ 1306.847543] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fc59e563-a28d-43a9-a7da-a35d9c5252e5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.859048] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.859228] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.859228] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.859457] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.859638] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.870518] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 386d020a-c7a5-439c-82eb-884ea70b97b5 in Status: IN_PROGRESS for 2s [ 1307.183606] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1307.183747] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1308.885473] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 386d020a-c7a5-439c-82eb-884ea70b97b5 in Status: SUCCESS [ 1308.885909] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.185500] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1312.185919] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1315.237378] env[65471]: INFO networking_nsxv3.common.synchronization [req-66f1082a-9da4-4866-8ca5-c0d4ada4893b req-12921dc9-c6d5-4af6-9d2c-a0caa48c870d tempest-ServersNegativeTestJSON-1797710450 tempest-ServersNegativeTestJSON-1797710450-project-member] Enqueued Resource ID: 386d020a-c7a5-439c-82eb-884ea70b97b5 with Priority: HIGHEST for action security_group_members [ 1315.239265] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 386d020a-c7a5-439c-82eb-884ea70b97b5 with Priority: HIGHEST for action security_group_members [ 1315.239265] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-386d020a-c7a5-439c-82eb-884ea70b97b5 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.239265] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.239265] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.239265] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.239624] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.239754] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.239849] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.240158] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.241129] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.241325] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('386d020a-c7a5-439c-82eb-884ea70b97b5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1315.563059] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock network-197 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.563224] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "network-197" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.563376] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "network-197" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.563803] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "network-197" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.564128] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.564362] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.564527] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.564790] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.564940] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.565213] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1315.565368] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1315.565509] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1315.565641] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1315.565790] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1315.565929] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1315.566100] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1315.586015] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1315.586189] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1315.586405] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1315.586644] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "network-197" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.587038] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock port-03ad74e0-e948-4d34-80e0-3dcc28091960 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.587265] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "port-03ad74e0-e948-4d34-80e0-3dcc28091960" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.587424] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "port-03ad74e0-e948-4d34-80e0-3dcc28091960" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.587816] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "port-03ad74e0-e948-4d34-80e0-3dcc28091960" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.587957] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03ad74e0-e948-4d34-80e0-3dcc28091960',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1315.744737] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('386d020a-c7a5-439c-82eb-884ea70b97b5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.090319] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.090537] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.090665] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.090965] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.091129] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.091289] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Segment Port 03ad74e0-e948-4d34-80e0-3dcc28091960 not found, creating... [ 1316.091565] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.091746] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.091925] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.092173] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.092330] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.092615] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.092767] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.092880] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.093128] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.093249] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.093364] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Resource: SegmentPort with ID: 03ad74e0-e948-4d34-80e0-3dcc28091960 is going to be created. [ 1316.115311] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.115568] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.115720] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.116069] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.116472] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.116637] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "port-03ad74e0-e948-4d34-80e0-3dcc28091960" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.246645] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('386d020a-c7a5-439c-82eb-884ea70b97b5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.748576] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.748747] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.748820] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.749062] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.749200] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.749299] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 386d020a-c7a5-439c-82eb-884ea70b97b5 is going to be updated. [ 1316.781368] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.781630] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.781630] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.781798] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.781944] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.813673] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 386d020a-c7a5-439c-82eb-884ea70b97b5 in Status: IN_PROGRESS for 2s [ 1316.848505] env[65471]: INFO networking_nsxv3.common.synchronization [req-66f1082a-9da4-4866-8ca5-c0d4ada4893b req-945ea192-ef0e-49bb-8591-6ac67c4a1d07 service nova] Enqueued Resource ID: 386d020a-c7a5-439c-82eb-884ea70b97b5 with Priority: HIGHEST for action security_group_rules [ 1316.848775] env[65471]: INFO networking_nsxv3.common.synchronization [req-66f1082a-9da4-4866-8ca5-c0d4ada4893b req-945ea192-ef0e-49bb-8591-6ac67c4a1d07 service nova] Enqueued Resource ID: 386d020a-c7a5-439c-82eb-884ea70b97b5 with Priority: HIGHEST for action security_group_members [ 1316.848925] env[65471]: INFO networking_nsxv3.common.synchronization [req-66f1082a-9da4-4866-8ca5-c0d4ada4893b req-945ea192-ef0e-49bb-8591-6ac67c4a1d07 service nova] Enqueued Resource ID: 03ad74e0-e948-4d34-80e0-3dcc28091960 with Priority: HIGHEST for action port [ 1316.849472] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 386d020a-c7a5-439c-82eb-884ea70b97b5 with Priority: HIGHEST for action security_group_rules [ 1316.849850] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 386d020a-c7a5-439c-82eb-884ea70b97b5 with Priority: HIGHEST for action security_group_members [ 1316.849975] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03ad74e0-e948-4d34-80e0-3dcc28091960 with Priority: HIGHEST for action port [ 1316.850324] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-386d020a-c7a5-439c-82eb-884ea70b97b5 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.850391] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.850457] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.850660] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.850741] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('386d020a-c7a5-439c-82eb-884ea70b97b5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.854646] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-386d020a-c7a5-439c-82eb-884ea70b97b5 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.854646] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.854646] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-03ad74e0-e948-4d34-80e0-3dcc28091960 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.854646] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-03ad74e0-e948-4d34-80e0-3dcc28091960" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.854646] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-03ad74e0-e948-4d34-80e0-3dcc28091960" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.854646] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-03ad74e0-e948-4d34-80e0-3dcc28091960" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.854646] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03ad74e0-e948-4d34-80e0-3dcc28091960',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1317.353237] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-386d020a-c7a5-439c-82eb-884ea70b97b5 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.353646] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.355756] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 03ad74e0-e948-4d34-80e0-3dcc28091960 with status ACTIVE [ 1317.355964] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.356098] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.356162] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.356453] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.356571] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.356772] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.356831] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.356903] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.357108] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.357148] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.357339] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.357446] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.357506] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.357644] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.357718] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.357801] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 03ad74e0-e948-4d34-80e0-3dcc28091960 is going to be updated. [ 1317.380527] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.380743] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.380743] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.380888] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.381041] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.381206] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-03ad74e0-e948-4d34-80e0-3dcc28091960" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.824115] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 386d020a-c7a5-439c-82eb-884ea70b97b5 in Status: SUCCESS [ 1318.824540] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.824657] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.825020] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.825314] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.825492] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.825595] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.825848] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.825979] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.826146] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('386d020a-c7a5-439c-82eb-884ea70b97b5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1319.328626] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('386d020a-c7a5-439c-82eb-884ea70b97b5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1319.831424] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('386d020a-c7a5-439c-82eb-884ea70b97b5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.334469] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.334678] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.334678] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.334842] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.334932] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.335044] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 386d020a-c7a5-439c-82eb-884ea70b97b5 is going to be updated. [ 1320.367622] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.367934] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.367934] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.368100] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.368173] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.377166] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 386d020a-c7a5-439c-82eb-884ea70b97b5 in Status: IN_PROGRESS for 2s [ 1321.851622] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1321.852059] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1322.388980] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 386d020a-c7a5-439c-82eb-884ea70b97b5 in Status: SUCCESS [ 1322.389213] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.389389] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.389627] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.389810] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.389929] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.389996] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.390157] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.390237] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.390321] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.390415] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('386d020a-c7a5-439c-82eb-884ea70b97b5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1322.893439] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-386d020a-c7a5-439c-82eb-884ea70b97b5 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.893898] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.893898] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.894032] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.894114] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.894270] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.894353] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.894527] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.894619] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.894708] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.894862] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-386d020a-c7a5-439c-82eb-884ea70b97b5 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.894958] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.895033] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.895167] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.895308] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.895407] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.895466] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.895603] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.895678] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.895755] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.895845] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('386d020a-c7a5-439c-82eb-884ea70b97b5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1323.398117] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 386d020a-c7a5-439c-82eb-884ea70b97b5: rpc.has_security_group_logging(os_id): False [ 1323.418096] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.418333] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.418333] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.418498] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.418588] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.418829] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.418945] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.418982] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.419137] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.419213] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.419404] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.419542] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.419597] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.419706] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.419778] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.419950] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.420051] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.420116] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.420256] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.420331] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.420425] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 386d020a-c7a5-439c-82eb-884ea70b97b5 is going to be updated. [ 1323.482402] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.482730] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.482730] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.482878] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.482976] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.497138] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 386d020a-c7a5-439c-82eb-884ea70b97b5 in Status: IN_PROGRESS for 2s [ 1325.512645] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 386d020a-c7a5-439c-82eb-884ea70b97b5 in Status: SUCCESS [ 1325.513132] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.377903] env[65471]: INFO networking_nsxv3.common.synchronization [req-0145cbac-48e4-4ce2-bbcc-22e9a6be463e req-fd111a74-e516-41e0-bc6a-3603abcc18b8 tempest-ServersNegativeTestJSON-1797710450 tempest-ServersNegativeTestJSON-1797710450-project-member] Enqueued Resource ID: 386d020a-c7a5-439c-82eb-884ea70b97b5 with Priority: HIGHEST for action security_group_members [ 1326.378781] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 386d020a-c7a5-439c-82eb-884ea70b97b5 with Priority: HIGHEST for action security_group_members [ 1326.378781] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-386d020a-c7a5-439c-82eb-884ea70b97b5 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.378872] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.378953] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.379273] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.379492] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.379624] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.379680] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.380103] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.380103] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.380103] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('386d020a-c7a5-439c-82eb-884ea70b97b5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1326.883065] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('386d020a-c7a5-439c-82eb-884ea70b97b5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.386187] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('386d020a-c7a5-439c-82eb-884ea70b97b5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.888927] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.889574] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.889574] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.889574] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.889574] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.889574] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 386d020a-c7a5-439c-82eb-884ea70b97b5 is going to be updated. [ 1327.922311] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.922491] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.922560] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.922721] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.922862] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.931597] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 386d020a-c7a5-439c-82eb-884ea70b97b5 in Status: IN_PROGRESS for 2s [ 1329.944519] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 386d020a-c7a5-439c-82eb-884ea70b97b5 in Status: SUCCESS [ 1329.944962] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.379767] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1331.380154] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1336.381067] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1336.381279] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1341.381941] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1341.382368] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1346.383185] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1346.383571] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1351.384395] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1351.384768] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1355.711870] env[65471]: INFO networking_nsxv3.common.synchronization [req-024471f7-2c31-4ff2-9212-4e0f409e9a1e req-e8d54be5-f949-4125-b1bb-84315b54e9b7 tempest-ServerActionsV293TestJSON-1492347165 tempest-ServerActionsV293TestJSON-1492347165-project-member] Enqueued Resource ID: fc59e563-a28d-43a9-a7da-a35d9c5252e5 with Priority: HIGHEST for action security_group_members [ 1355.712638] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc59e563-a28d-43a9-a7da-a35d9c5252e5 with Priority: HIGHEST for action security_group_members [ 1355.712757] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc59e563-a28d-43a9-a7da-a35d9c5252e5 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.712845] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc59e563-a28d-43a9-a7da-a35d9c5252e5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.712892] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc59e563-a28d-43a9-a7da-a35d9c5252e5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.713572] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc59e563-a28d-43a9-a7da-a35d9c5252e5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.713572] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.713572] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.713818] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.713818] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.713895] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.714414] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc59e563-a28d-43a9-a7da-a35d9c5252e5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1356.215757] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.215954] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.216039] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.216210] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.216584] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.216584] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.216735] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.216735] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.217839] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.217839] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.217839] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc59e563-a28d-43a9-a7da-a35d9c5252e5 is going to be updated. [ 1356.253993] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.254159] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.254231] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.254436] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.254588] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.262999] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc59e563-a28d-43a9-a7da-a35d9c5252e5 in Status: IN_PROGRESS for 2s [ 1358.273350] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc59e563-a28d-43a9-a7da-a35d9c5252e5 in Status: SUCCESS [ 1358.273668] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc59e563-a28d-43a9-a7da-a35d9c5252e5 deletion is rescheduled due to dependency. [ 1358.273668] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc59e563-a28d-43a9-a7da-a35d9c5252e5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.681585] env[65471]: INFO networking_nsxv3.common.synchronization [None req-7049bdd8-d670-4c5b-8c82-146984a618fd None None] Enqueued Resource ID: d9a961ed-7c82-4db5-a362-c4a4d8eae6cc with Priority: HIGHEST for action port [ 1359.682195] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9a961ed-7c82-4db5-a362-c4a4d8eae6cc with Priority: HIGHEST for action port [ 1359.682546] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-d9a961ed-7c82-4db5-a362-c4a4d8eae6cc taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.682711] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d9a961ed-7c82-4db5-a362-c4a4d8eae6cc" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.682809] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d9a961ed-7c82-4db5-a362-c4a4d8eae6cc" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.683097] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d9a961ed-7c82-4db5-a362-c4a4d8eae6cc" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.683208] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9a961ed-7c82-4db5-a362-c4a4d8eae6cc',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1360.055369] env[65471]: INFO networking_nsxv3.common.synchronization [None req-a757e749-24f3-4108-9051-33055c1ef5df tempest-AttachVolumeShelveTestJSON-1125436198 tempest-AttachVolumeShelveTestJSON-1125436198-project-member] Enqueued Resource ID: 1ba9348d-e766-444a-b0d0-149fd9ba05dd with Priority: HIGHEST for action security_group_rules [ 1360.055369] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ba9348d-e766-444a-b0d0-149fd9ba05dd with Priority: HIGHEST for action security_group_rules [ 1360.055369] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ba9348d-e766-444a-b0d0-149fd9ba05dd taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.055369] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ba9348d-e766-444a-b0d0-149fd9ba05dd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.055369] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ba9348d-e766-444a-b0d0-149fd9ba05dd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.055621] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ba9348d-e766-444a-b0d0-149fd9ba05dd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.056221] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ba9348d-e766-444a-b0d0-149fd9ba05dd',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1360.154403] env[65471]: INFO networking_nsxv3.common.synchronization [None req-14a10e76-cb4b-40db-b5a6-e0cedef03d8d tempest-AttachVolumeShelveTestJSON-1125436198 tempest-AttachVolumeShelveTestJSON-1125436198-project-member] Enqueued Resource ID: 1ba9348d-e766-444a-b0d0-149fd9ba05dd with Priority: HIGHEST for action security_group_rules [ 1360.155035] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ba9348d-e766-444a-b0d0-149fd9ba05dd with Priority: HIGHEST for action security_group_rules [ 1360.155691] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ba9348d-e766-444a-b0d0-149fd9ba05dd taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.155691] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ba9348d-e766-444a-b0d0-149fd9ba05dd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.184895] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d9a961ed-7c82-4db5-a362-c4a4d8eae6cc [ 1360.185139] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.185272] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.185336] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.185901] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.185901] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.185901] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d9a961ed-7c82-4db5-a362-c4a4d8eae6cc already deleted. [ 1360.185901] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d9a961ed-7c82-4db5-a362-c4a4d8eae6cc" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.578331] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.578331] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.578331] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.578331] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.578331] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.578331] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ba9348d-e766-444a-b0d0-149fd9ba05dd already deleted. [ 1360.578331] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ba9348d-e766-444a-b0d0-149fd9ba05dd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.578331] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ba9348d-e766-444a-b0d0-149fd9ba05dd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.578331] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ba9348d-e766-444a-b0d0-149fd9ba05dd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.578331] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ba9348d-e766-444a-b0d0-149fd9ba05dd',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.099055] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.099454] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.099454] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.099454] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.099595] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.099636] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ba9348d-e766-444a-b0d0-149fd9ba05dd already deleted. [ 1361.099709] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ba9348d-e766-444a-b0d0-149fd9ba05dd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.788246] env[65471]: INFO networking_nsxv3.common.synchronization [None req-3aee421a-1ce5-4fa9-8396-388764383b6f None None] Enqueued Resource ID: 853ef0b0-3221-4853-a74e-008a1f632830 with Priority: HIGHEST for action port [ 1361.788246] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 853ef0b0-3221-4853-a74e-008a1f632830 with Priority: HIGHEST for action port [ 1361.788735] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-853ef0b0-3221-4853-a74e-008a1f632830 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.790432] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-853ef0b0-3221-4853-a74e-008a1f632830" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.790432] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-853ef0b0-3221-4853-a74e-008a1f632830" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.790432] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-853ef0b0-3221-4853-a74e-008a1f632830" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.790432] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('853ef0b0-3221-4853-a74e-008a1f632830',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1362.292659] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 853ef0b0-3221-4853-a74e-008a1f632830 [ 1362.293058] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.293136] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.293241] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.293752] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.293852] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.293960] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:853ef0b0-3221-4853-a74e-008a1f632830 already deleted. [ 1362.294075] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-853ef0b0-3221-4853-a74e-008a1f632830" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.588874] env[65471]: INFO networking_nsxv3.common.synchronization [req-852b153b-2cd9-4d93-b2c2-30f50995c4ce req-fa1765ff-ac77-4149-beb9-53e79b5e1668 tempest-AttachVolumeShelveTestJSON-1125436198 tempest-AttachVolumeShelveTestJSON-1125436198-project-member] Enqueued Resource ID: 1ba9348d-e766-444a-b0d0-149fd9ba05dd with Priority: HIGHEST for action security_group_members [ 1365.589413] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ba9348d-e766-444a-b0d0-149fd9ba05dd with Priority: HIGHEST for action security_group_members [ 1365.589413] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ba9348d-e766-444a-b0d0-149fd9ba05dd taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.589518] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ba9348d-e766-444a-b0d0-149fd9ba05dd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.589606] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ba9348d-e766-444a-b0d0-149fd9ba05dd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.589789] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ba9348d-e766-444a-b0d0-149fd9ba05dd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.589938] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.590045] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.590101] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.590272] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.590341] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.590413] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ba9348d-e766-444a-b0d0-149fd9ba05dd',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1365.848466] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock network-631 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.848466] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "network-631" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.848466] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "network-631" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.848795] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "network-631" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.849037] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.849220] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.849334] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.849555] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.849695] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.849919] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1365.850042] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1365.850186] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1365.850250] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1365.850355] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1365.850460] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1365.850587] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1365.871705] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1365.871948] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1365.872144] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1365.872318] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "network-631" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.872617] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock port-7ac69b0d-f824-4859-adf4-6542f97faf19 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.872783] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "port-7ac69b0d-f824-4859-adf4-6542f97faf19" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.872899] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "port-7ac69b0d-f824-4859-adf4-6542f97faf19" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.873233] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "port-7ac69b0d-f824-4859-adf4-6542f97faf19" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.873368] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ac69b0d-f824-4859-adf4-6542f97faf19',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1366.092387] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.092611] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.092611] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.092828] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.092933] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.093150] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.093303] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.093303] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.093485] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.093584] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.093630] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ba9348d-e766-444a-b0d0-149fd9ba05dd already deleted. [ 1366.093677] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ba9348d-e766-444a-b0d0-149fd9ba05dd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.375414] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.375644] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.375768] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.376070] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.376224] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.376379] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Segment Port 7ac69b0d-f824-4859-adf4-6542f97faf19 not found, creating... [ 1366.376639] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.376837] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.376946] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.377173] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.377307] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.377582] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.377731] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.377874] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.378098] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.378232] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.378368] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Resource: SegmentPort with ID: 7ac69b0d-f824-4859-adf4-6542f97faf19 is going to be created. [ 1366.399487] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.399698] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.399748] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.399977] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.400215] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.400429] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "port-7ac69b0d-f824-4859-adf4-6542f97faf19" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.092431] env[65471]: INFO networking_nsxv3.common.synchronization [req-852b153b-2cd9-4d93-b2c2-30f50995c4ce req-accad4a4-a510-4756-8b7d-88a4b6eb5391 service nova] Enqueued Resource ID: 1ba9348d-e766-444a-b0d0-149fd9ba05dd with Priority: HIGHEST for action security_group_rules [ 1367.092684] env[65471]: INFO networking_nsxv3.common.synchronization [req-852b153b-2cd9-4d93-b2c2-30f50995c4ce req-accad4a4-a510-4756-8b7d-88a4b6eb5391 service nova] Enqueued Resource ID: 1ba9348d-e766-444a-b0d0-149fd9ba05dd with Priority: HIGHEST for action security_group_members [ 1367.092741] env[65471]: INFO networking_nsxv3.common.synchronization [req-852b153b-2cd9-4d93-b2c2-30f50995c4ce req-accad4a4-a510-4756-8b7d-88a4b6eb5391 service nova] Enqueued Resource ID: 7ac69b0d-f824-4859-adf4-6542f97faf19 with Priority: HIGHEST for action port [ 1367.092967] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ba9348d-e766-444a-b0d0-149fd9ba05dd with Priority: HIGHEST for action security_group_rules [ 1367.093113] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ba9348d-e766-444a-b0d0-149fd9ba05dd with Priority: HIGHEST for action security_group_members [ 1367.093213] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ac69b0d-f824-4859-adf4-6542f97faf19 with Priority: HIGHEST for action port [ 1367.094203] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ba9348d-e766-444a-b0d0-149fd9ba05dd taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.094317] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ba9348d-e766-444a-b0d0-149fd9ba05dd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.094380] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ba9348d-e766-444a-b0d0-149fd9ba05dd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.094571] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ba9348d-e766-444a-b0d0-149fd9ba05dd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.094651] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ba9348d-e766-444a-b0d0-149fd9ba05dd',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1367.095611] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ba9348d-e766-444a-b0d0-149fd9ba05dd taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.095733] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ba9348d-e766-444a-b0d0-149fd9ba05dd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.095805] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ba9348d-e766-444a-b0d0-149fd9ba05dd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.095974] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ba9348d-e766-444a-b0d0-149fd9ba05dd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.096142] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.096239] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.096303] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.096448] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.096529] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.097507] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ba9348d-e766-444a-b0d0-149fd9ba05dd',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1367.097507] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ac69b0d-f824-4859-adf4-6542f97faf19 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.098066] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ac69b0d-f824-4859-adf4-6542f97faf19" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.098066] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ac69b0d-f824-4859-adf4-6542f97faf19" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.098066] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ac69b0d-f824-4859-adf4-6542f97faf19" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.098066] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ac69b0d-f824-4859-adf4-6542f97faf19',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1367.599348] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ba9348d-e766-444a-b0d0-149fd9ba05dd taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.599572] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ba9348d-e766-444a-b0d0-149fd9ba05dd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.599757] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ba9348d-e766-444a-b0d0-149fd9ba05dd',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1367.600793] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7ac69b0d-f824-4859-adf4-6542f97faf19 with status ACTIVE [ 1367.601426] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.601426] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.601426] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.601426] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.601704] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.601704] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.601786] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.601786] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.602688] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.602688] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.602688] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.602688] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.602688] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.602688] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.602688] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.602688] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7ac69b0d-f824-4859-adf4-6542f97faf19 is going to be updated. [ 1367.621952] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.622187] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.622187] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.622357] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.622487] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.622650] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ac69b0d-f824-4859-adf4-6542f97faf19" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.105267] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ba9348d-e766-444a-b0d0-149fd9ba05dd',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1368.159118] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock network-197 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.159407] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "network-197" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.159543] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "network-197" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.159802] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "network-197" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.160428] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.160428] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.160428] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.160639] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.160681] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.160852] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1368.160963] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1368.161080] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1368.161261] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1368.161314] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1368.161378] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1368.161501] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1368.181576] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1368.181744] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1368.181886] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1368.182081] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "network-197" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.182389] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock port-3bef2f34-a1fb-48d0-bc78-dadbc9da2f06 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.182552] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "port-3bef2f34-a1fb-48d0-bc78-dadbc9da2f06" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.182671] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "port-3bef2f34-a1fb-48d0-bc78-dadbc9da2f06" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.183144] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "port-3bef2f34-a1fb-48d0-bc78-dadbc9da2f06" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.183292] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3bef2f34-a1fb-48d0-bc78-dadbc9da2f06',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1368.607399] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.607640] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.607640] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.607841] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.607941] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.608049] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ba9348d-e766-444a-b0d0-149fd9ba05dd is going to be created. [ 1368.630682] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.630889] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.630889] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.631122] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.631281] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.640073] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ba9348d-e766-444a-b0d0-149fd9ba05dd in Status: UNINITIALIZED for 2s [ 1368.685394] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.685614] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.685726] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.686028] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.686208] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.686500] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.686659] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.686775] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.687035] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.687180] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.687456] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.687608] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.687721] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.687939] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.688078] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.688213] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Resource: SegmentPort with ID: 3bef2f34-a1fb-48d0-bc78-dadbc9da2f06 is going to be updated. [ 1368.708782] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.709029] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.709203] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.709482] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.709734] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.709985] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "port-3bef2f34-a1fb-48d0-bc78-dadbc9da2f06" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.384446] env[65471]: INFO networking_nsxv3.common.synchronization [req-937fc4af-d872-443d-a91b-3228566b28e9 req-5ad73542-11da-458e-ba17-6ddd783604cd service nova] Enqueued Resource ID: 386d020a-c7a5-439c-82eb-884ea70b97b5 with Priority: HIGHEST for action security_group_rules [ 1369.384752] env[65471]: INFO networking_nsxv3.common.synchronization [req-937fc4af-d872-443d-a91b-3228566b28e9 req-5ad73542-11da-458e-ba17-6ddd783604cd service nova] Enqueued Resource ID: 386d020a-c7a5-439c-82eb-884ea70b97b5 with Priority: HIGHEST for action security_group_members [ 1369.384752] env[65471]: INFO networking_nsxv3.common.synchronization [req-937fc4af-d872-443d-a91b-3228566b28e9 req-5ad73542-11da-458e-ba17-6ddd783604cd service nova] Enqueued Resource ID: 3bef2f34-a1fb-48d0-bc78-dadbc9da2f06 with Priority: HIGHEST for action port [ 1369.385057] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 386d020a-c7a5-439c-82eb-884ea70b97b5 with Priority: HIGHEST for action security_group_rules [ 1369.385199] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 386d020a-c7a5-439c-82eb-884ea70b97b5 with Priority: HIGHEST for action security_group_members [ 1369.385297] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bef2f34-a1fb-48d0-bc78-dadbc9da2f06 with Priority: HIGHEST for action port [ 1369.385845] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-386d020a-c7a5-439c-82eb-884ea70b97b5 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.385978] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.386122] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.386325] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.386419] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('386d020a-c7a5-439c-82eb-884ea70b97b5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1369.387283] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-386d020a-c7a5-439c-82eb-884ea70b97b5 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.387409] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.387471] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.387607] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.387745] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.387986] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.388085] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.388251] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.388355] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.388434] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('386d020a-c7a5-439c-82eb-884ea70b97b5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1369.389513] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-3bef2f34-a1fb-48d0-bc78-dadbc9da2f06 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.389626] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3bef2f34-a1fb-48d0-bc78-dadbc9da2f06" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.389699] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3bef2f34-a1fb-48d0-bc78-dadbc9da2f06" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.389846] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3bef2f34-a1fb-48d0-bc78-dadbc9da2f06" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.389920] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3bef2f34-a1fb-48d0-bc78-dadbc9da2f06',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1369.891915] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-386d020a-c7a5-439c-82eb-884ea70b97b5 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.892089] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.892277] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('386d020a-c7a5-439c-82eb-884ea70b97b5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1369.893362] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3bef2f34-a1fb-48d0-bc78-dadbc9da2f06 with status ACTIVE [ 1369.893454] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.893512] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.893559] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.893758] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.893845] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.894029] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.894145] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.894195] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.894330] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.894404] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.894594] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.894726] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.894823] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.895126] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.895232] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.895335] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3bef2f34-a1fb-48d0-bc78-dadbc9da2f06 is going to be updated. [ 1369.915611] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.915802] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.915802] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.915998] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.916154] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.916308] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3bef2f34-a1fb-48d0-bc78-dadbc9da2f06" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.397783] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('386d020a-c7a5-439c-82eb-884ea70b97b5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1370.650530] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ba9348d-e766-444a-b0d0-149fd9ba05dd in Status: SUCCESS [ 1370.650846] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ba9348d-e766-444a-b0d0-149fd9ba05dd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.651107] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ba9348d-e766-444a-b0d0-149fd9ba05dd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.651410] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ba9348d-e766-444a-b0d0-149fd9ba05dd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.651676] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.651845] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.651942] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.652168] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.652284] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.652422] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ba9348d-e766-444a-b0d0-149fd9ba05dd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.652564] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1ba9348d-e766-444a-b0d0-149fd9ba05dd',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1370.901831] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.902032] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.902082] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.902299] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.902389] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.902490] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 386d020a-c7a5-439c-82eb-884ea70b97b5 is going to be updated. [ 1370.931965] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.932202] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.932309] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.932641] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.932876] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.942595] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 386d020a-c7a5-439c-82eb-884ea70b97b5 in Status: IN_PROGRESS for 2s [ 1371.155535] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1ba9348d-e766-444a-b0d0-149fd9ba05dd',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1371.658677] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1ba9348d-e766-444a-b0d0-149fd9ba05dd: rpc.has_security_group_logging(os_id): False [ 1371.674692] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.675117] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.675200] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.675466] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.676026] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.676026] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.676026] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.676236] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.676236] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.676309] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.676359] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ba9348d-e766-444a-b0d0-149fd9ba05dd is going to be created. [ 1371.733691] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.733915] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.733915] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.734864] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.734864] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.744643] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ba9348d-e766-444a-b0d0-149fd9ba05dd in Status: IN_PROGRESS for 2s [ 1372.953019] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 386d020a-c7a5-439c-82eb-884ea70b97b5 in Status: SUCCESS [ 1372.953430] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.953475] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.953668] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.953857] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.954020] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.954126] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.954297] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.954382] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.954472] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.954597] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('386d020a-c7a5-439c-82eb-884ea70b97b5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1373.458072] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-386d020a-c7a5-439c-82eb-884ea70b97b5 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.458072] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.458072] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.458391] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.458574] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.458703] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.458802] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.459054] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.459151] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.459257] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.459448] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-386d020a-c7a5-439c-82eb-884ea70b97b5 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.459565] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.459628] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.459776] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.459925] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.460042] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.460106] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.460246] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.460323] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.460410] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.460531] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('386d020a-c7a5-439c-82eb-884ea70b97b5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1373.757787] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ba9348d-e766-444a-b0d0-149fd9ba05dd in Status: SUCCESS [ 1373.758138] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ba9348d-e766-444a-b0d0-149fd9ba05dd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.962695] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 386d020a-c7a5-439c-82eb-884ea70b97b5: rpc.has_security_group_logging(os_id): False [ 1373.981460] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.981760] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.981931] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.982079] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.982192] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.982470] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.982572] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.982685] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.982895] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.983048] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.983275] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.983395] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.983459] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.983645] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.983744] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.983957] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.984079] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.984159] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.984304] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.984374] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.984465] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 386d020a-c7a5-439c-82eb-884ea70b97b5 is going to be updated. [ 1374.047878] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.048181] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.048292] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.048513] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.048660] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.066705] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 386d020a-c7a5-439c-82eb-884ea70b97b5 in Status: IN_PROGRESS for 2s [ 1374.386523] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1374.386783] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1376.084509] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 386d020a-c7a5-439c-82eb-884ea70b97b5 in Status: SUCCESS [ 1376.085033] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.387269] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1379.387653] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1384.388207] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1384.388565] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1389.389382] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1389.389811] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1394.390979] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1394.391403] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1396.324862] env[65471]: INFO networking_nsxv3.common.synchronization [req-91661d9b-62cb-421b-9d19-c25c94847ab5 req-a909d7f3-5199-43fe-b11f-7ba63f2a6d85 tempest-ServersNegativeTestJSON-1797710450 tempest-ServersNegativeTestJSON-1797710450-project-member] Enqueued Resource ID: 386d020a-c7a5-439c-82eb-884ea70b97b5 with Priority: HIGHEST for action security_group_members [ 1396.325248] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 386d020a-c7a5-439c-82eb-884ea70b97b5 with Priority: HIGHEST for action security_group_members [ 1396.325559] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-386d020a-c7a5-439c-82eb-884ea70b97b5 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.325678] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.325746] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.325934] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.326099] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.326200] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.326253] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.326397] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.326561] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.326561] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('386d020a-c7a5-439c-82eb-884ea70b97b5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1396.828715] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.828715] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.829032] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.829032] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.829119] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.829320] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.829430] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.829488] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.829632] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.829709] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.829795] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 386d020a-c7a5-439c-82eb-884ea70b97b5 is going to be updated. [ 1396.858634] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.858826] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.858826] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.859037] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.859182] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.867632] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 386d020a-c7a5-439c-82eb-884ea70b97b5 in Status: IN_PROGRESS for 2s [ 1398.878873] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 386d020a-c7a5-439c-82eb-884ea70b97b5 in Status: SUCCESS [ 1398.878873] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 386d020a-c7a5-439c-82eb-884ea70b97b5 deletion is rescheduled due to dependency. [ 1398.878873] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-386d020a-c7a5-439c-82eb-884ea70b97b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.326659] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1401.326958] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1406.328117] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1406.328410] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1411.330069] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1411.330069] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1416.331076] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1416.331076] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1421.331930] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1421.332451] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1426.333340] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1426.333741] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1431.334454] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1431.334870] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1436.335751] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1436.336130] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1441.337016] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1441.337381] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1445.102661] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock network-631 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1445.102975] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "network-631" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1445.102975] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "network-631" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1445.103252] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "network-631" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1445.103616] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1445.103725] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1445.103799] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1445.103988] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1445.104300] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1445.104513] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1445.104630] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1445.104743] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1445.104880] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1445.105018] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1445.105131] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1445.105262] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1445.132760] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1445.132954] env[65471]: DEBUG dogpile.cache.region [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1445.133062] env[65471]: DEBUG dogpile.lock [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1445.133235] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "network-631" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1445.133549] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock port-7ac69b0d-f824-4859-adf4-6542f97faf19 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1445.133746] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "port-7ac69b0d-f824-4859-adf4-6542f97faf19" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1445.133878] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "port-7ac69b0d-f824-4859-adf4-6542f97faf19" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1445.134213] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "port-7ac69b0d-f824-4859-adf4-6542f97faf19" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1445.134353] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ac69b0d-f824-4859-adf4-6542f97faf19',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1445.637036] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1445.637411] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1445.637411] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1445.637777] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1445.637937] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1445.638264] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1445.638430] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1445.638548] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1445.638834] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1445.638971] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1445.639269] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1445.639421] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1445.639535] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1445.639738] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1445.639872] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1445.640027] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Resource: SegmentPort with ID: 7ac69b0d-f824-4859-adf4-6542f97faf19 is going to be updated. [ 1445.666417] env[65471]: DEBUG networking_nsxv3.common.locking [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1445.666658] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1445.666752] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1445.667155] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1445.667375] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1445.667630] env[65471]: DEBUG oslo_concurrency.lockutils [None req-6bf5124e-c63e-4769-87ee-3f2019459d44 None None] Releasing lock "port-7ac69b0d-f824-4859-adf4-6542f97faf19" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1446.331682] env[65471]: INFO networking_nsxv3.common.synchronization [req-6cb06e53-4681-4f3b-8879-b764003d02b1 req-62016a3f-146b-4927-af33-52991815320b service nova] Enqueued Resource ID: 1ba9348d-e766-444a-b0d0-149fd9ba05dd with Priority: HIGHEST for action security_group_rules [ 1446.331992] env[65471]: INFO networking_nsxv3.common.synchronization [req-6cb06e53-4681-4f3b-8879-b764003d02b1 req-62016a3f-146b-4927-af33-52991815320b service nova] Enqueued Resource ID: 1ba9348d-e766-444a-b0d0-149fd9ba05dd with Priority: HIGHEST for action security_group_members [ 1446.331992] env[65471]: INFO networking_nsxv3.common.synchronization [req-6cb06e53-4681-4f3b-8879-b764003d02b1 req-62016a3f-146b-4927-af33-52991815320b service nova] Enqueued Resource ID: 7ac69b0d-f824-4859-adf4-6542f97faf19 with Priority: HIGHEST for action port [ 1446.332462] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ba9348d-e766-444a-b0d0-149fd9ba05dd with Priority: HIGHEST for action security_group_rules [ 1446.332600] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ba9348d-e766-444a-b0d0-149fd9ba05dd with Priority: HIGHEST for action security_group_members [ 1446.332698] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ac69b0d-f824-4859-adf4-6542f97faf19 with Priority: HIGHEST for action port [ 1446.332964] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ba9348d-e766-444a-b0d0-149fd9ba05dd taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1446.333206] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ba9348d-e766-444a-b0d0-149fd9ba05dd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1446.333332] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ba9348d-e766-444a-b0d0-149fd9ba05dd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1446.333462] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ba9348d-e766-444a-b0d0-149fd9ba05dd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1446.333536] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ba9348d-e766-444a-b0d0-149fd9ba05dd',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1446.334809] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ba9348d-e766-444a-b0d0-149fd9ba05dd taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1446.335028] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ba9348d-e766-444a-b0d0-149fd9ba05dd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1446.335120] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ba9348d-e766-444a-b0d0-149fd9ba05dd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1446.335284] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ba9348d-e766-444a-b0d0-149fd9ba05dd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1446.335459] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1446.335563] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1446.335657] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1446.335893] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1446.336080] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1446.336080] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ba9348d-e766-444a-b0d0-149fd9ba05dd',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1446.337223] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ac69b0d-f824-4859-adf4-6542f97faf19 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1446.337545] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ac69b0d-f824-4859-adf4-6542f97faf19" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1446.337629] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ac69b0d-f824-4859-adf4-6542f97faf19" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1446.337792] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ac69b0d-f824-4859-adf4-6542f97faf19" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1446.337866] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ac69b0d-f824-4859-adf4-6542f97faf19',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1446.836271] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ba9348d-e766-444a-b0d0-149fd9ba05dd taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1446.836521] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ba9348d-e766-444a-b0d0-149fd9ba05dd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1446.837798] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ba9348d-e766-444a-b0d0-149fd9ba05dd',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1446.841620] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7ac69b0d-f824-4859-adf4-6542f97faf19 with status ACTIVE [ 1446.841820] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1446.841939] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1446.842030] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1446.842232] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1446.842322] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1446.842504] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1446.842607] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1446.842672] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1446.842817] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1446.842887] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1446.843086] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1446.843173] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1446.843232] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1446.843373] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1446.843491] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1446.843548] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7ac69b0d-f824-4859-adf4-6542f97faf19 is going to be updated. [ 1446.864339] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1446.864601] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1446.864601] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1446.864777] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1446.864871] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1446.865045] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ac69b0d-f824-4859-adf4-6542f97faf19" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1447.340855] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ba9348d-e766-444a-b0d0-149fd9ba05dd',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1447.844610] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1447.844846] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1447.844846] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1447.845039] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1447.845131] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1447.845236] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ba9348d-e766-444a-b0d0-149fd9ba05dd is going to be updated. [ 1447.878902] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1447.879257] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1447.879257] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1447.879396] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1447.879616] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1447.888894] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ba9348d-e766-444a-b0d0-149fd9ba05dd in Status: IN_PROGRESS for 2s [ 1449.901306] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ba9348d-e766-444a-b0d0-149fd9ba05dd in Status: SUCCESS [ 1449.901727] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ba9348d-e766-444a-b0d0-149fd9ba05dd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1449.901870] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ba9348d-e766-444a-b0d0-149fd9ba05dd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1449.902225] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ba9348d-e766-444a-b0d0-149fd9ba05dd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1449.902550] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1449.902757] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1449.902888] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1449.903177] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1449.903332] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1449.903499] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ba9348d-e766-444a-b0d0-149fd9ba05dd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1449.903662] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1ba9348d-e766-444a-b0d0-149fd9ba05dd',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1450.406608] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1ba9348d-e766-444a-b0d0-149fd9ba05dd',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1450.909444] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1ba9348d-e766-444a-b0d0-149fd9ba05dd: rpc.has_security_group_logging(os_id): False [ 1450.926785] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1450.926974] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1450.926974] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1450.927193] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1450.927347] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1450.927724] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1450.927854] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1450.927920] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1450.928092] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1450.928171] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1450.928257] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ba9348d-e766-444a-b0d0-149fd9ba05dd is going to be updated. [ 1450.985295] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1450.985566] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1450.985566] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1450.985769] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1450.985920] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1451.000544] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ba9348d-e766-444a-b0d0-149fd9ba05dd in Status: IN_PROGRESS for 2s [ 1451.333598] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1451.333775] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1453.017353] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ba9348d-e766-444a-b0d0-149fd9ba05dd in Status: SUCCESS [ 1453.017797] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ba9348d-e766-444a-b0d0-149fd9ba05dd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1456.334952] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1456.335282] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1461.335953] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1461.336335] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1466.337213] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1466.337634] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1471.339016] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1471.339472] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1476.340120] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1476.341097] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1481.342064] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1481.342442] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1486.343245] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1486.343668] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1491.344851] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1491.344851] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1496.346128] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1496.346520] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1501.347448] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1501.347861] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1503.856779] env[65471]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] NSXv3 Agent Agent loop - iteration:3 completed [ 1503.857184] env[65471]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-d62d6300-eafc-4438-a668-dc83134e8ba4 None None] NSXv3 Agent Agent loop - iteration:4 started [ 1504.762061] env[65471]: INFO networking_nsxv3.common.synchronization [req-6854caab-18bd-4669-9c44-73a2d0eadc45 req-0272a3c5-50f7-446a-9e20-84466b2aacc9 tempest-AttachVolumeShelveTestJSON-1125436198 tempest-AttachVolumeShelveTestJSON-1125436198-project-member] Enqueued Resource ID: 1ba9348d-e766-444a-b0d0-149fd9ba05dd with Priority: HIGHEST for action security_group_members [ 1504.762639] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ba9348d-e766-444a-b0d0-149fd9ba05dd with Priority: HIGHEST for action security_group_members [ 1504.762946] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ba9348d-e766-444a-b0d0-149fd9ba05dd taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.763079] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ba9348d-e766-444a-b0d0-149fd9ba05dd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1504.763143] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ba9348d-e766-444a-b0d0-149fd9ba05dd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1504.763522] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ba9348d-e766-444a-b0d0-149fd9ba05dd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1504.763596] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.763717] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1504.763795] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1504.763987] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1504.764108] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1504.764192] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ba9348d-e766-444a-b0d0-149fd9ba05dd',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1505.266485] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.266886] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.266886] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.266886] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.267056] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.267188] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.267292] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.267356] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.267509] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.267588] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.267674] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ba9348d-e766-444a-b0d0-149fd9ba05dd is going to be updated. [ 1505.303350] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.303604] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.303657] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.303897] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.304116] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.312539] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ba9348d-e766-444a-b0d0-149fd9ba05dd in Status: IN_PROGRESS for 2s [ 1507.323416] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ba9348d-e766-444a-b0d0-149fd9ba05dd in Status: SUCCESS [ 1507.323806] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ba9348d-e766-444a-b0d0-149fd9ba05dd deletion is rescheduled due to dependency. [ 1507.323806] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ba9348d-e766-444a-b0d0-149fd9ba05dd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.435158] env[65471]: INFO networking_nsxv3.common.synchronization [None req-9eda425b-182c-4542-ab76-9b1b5f712483 tempest-AttachVolumeShelveTestJSON-1125436198 tempest-AttachVolumeShelveTestJSON-1125436198-project-member] Enqueued Resource ID: 6d988766-7a9f-4ce3-9d3d-ec0e546577b2 with Priority: HIGHEST for action security_group_rules [ 1509.435803] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d988766-7a9f-4ce3-9d3d-ec0e546577b2 with Priority: HIGHEST for action security_group_rules [ 1509.436394] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d988766-7a9f-4ce3-9d3d-ec0e546577b2 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.436594] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d988766-7a9f-4ce3-9d3d-ec0e546577b2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.436674] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d988766-7a9f-4ce3-9d3d-ec0e546577b2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.436965] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d988766-7a9f-4ce3-9d3d-ec0e546577b2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.437105] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d988766-7a9f-4ce3-9d3d-ec0e546577b2',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1509.516814] env[65471]: INFO networking_nsxv3.common.synchronization [None req-2aa3ddb0-bced-4fb9-ba60-cbb3bd8ecd2e tempest-AttachVolumeShelveTestJSON-1125436198 tempest-AttachVolumeShelveTestJSON-1125436198-project-member] Enqueued Resource ID: 6d988766-7a9f-4ce3-9d3d-ec0e546577b2 with Priority: HIGHEST for action security_group_rules [ 1509.516814] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d988766-7a9f-4ce3-9d3d-ec0e546577b2 with Priority: HIGHEST for action security_group_rules [ 1509.517323] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d988766-7a9f-4ce3-9d3d-ec0e546577b2 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.517323] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d988766-7a9f-4ce3-9d3d-ec0e546577b2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.960714] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.960897] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.960958] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.961185] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.961270] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.961369] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d988766-7a9f-4ce3-9d3d-ec0e546577b2 already deleted. [ 1509.961458] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d988766-7a9f-4ce3-9d3d-ec0e546577b2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.961604] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d988766-7a9f-4ce3-9d3d-ec0e546577b2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.961756] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d988766-7a9f-4ce3-9d3d-ec0e546577b2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.961838] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d988766-7a9f-4ce3-9d3d-ec0e546577b2',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1510.481789] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.482198] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.482198] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.482198] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.482304] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.482359] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d988766-7a9f-4ce3-9d3d-ec0e546577b2 already deleted. [ 1510.482455] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d988766-7a9f-4ce3-9d3d-ec0e546577b2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1514.517640] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1514.517899] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1514.831560] env[65471]: INFO networking_nsxv3.common.synchronization [req-9741ef73-011f-4971-a94c-f1de6b68ff16 req-05076a74-9fdd-4b80-872d-92c05216d242 tempest-AttachVolumeShelveTestJSON-1125436198 tempest-AttachVolumeShelveTestJSON-1125436198-project-member] Enqueued Resource ID: 6d988766-7a9f-4ce3-9d3d-ec0e546577b2 with Priority: HIGHEST for action security_group_members [ 1514.831560] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d988766-7a9f-4ce3-9d3d-ec0e546577b2 with Priority: HIGHEST for action security_group_members [ 1514.831560] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d988766-7a9f-4ce3-9d3d-ec0e546577b2 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1514.831560] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d988766-7a9f-4ce3-9d3d-ec0e546577b2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1514.831560] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d988766-7a9f-4ce3-9d3d-ec0e546577b2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1514.831560] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d988766-7a9f-4ce3-9d3d-ec0e546577b2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1514.831560] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1514.831560] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1514.831560] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1514.831560] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1514.831560] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1514.831560] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d988766-7a9f-4ce3-9d3d-ec0e546577b2',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1515.124532] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock network-631 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1515.124532] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "network-631" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1515.124532] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "network-631" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1515.124881] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "network-631" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1515.124948] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1515.125122] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1515.125240] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1515.125456] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1515.125596] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1515.125806] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1515.125928] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1515.126089] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1515.126151] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1515.126261] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1515.126389] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1515.126495] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1515.146730] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1515.146953] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1515.147044] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1515.147239] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "network-631" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1515.147562] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock port-109bba77-d592-44a2-b03e-6acb641f31c5 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1515.147736] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "port-109bba77-d592-44a2-b03e-6acb641f31c5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1515.147857] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "port-109bba77-d592-44a2-b03e-6acb641f31c5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1515.148231] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "port-109bba77-d592-44a2-b03e-6acb641f31c5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1515.148387] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('109bba77-d592-44a2-b03e-6acb641f31c5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1515.332880] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1515.333189] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1515.333189] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1515.333356] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1515.333356] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1515.333558] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1515.333659] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1515.333717] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1515.333866] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1515.333940] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1515.334074] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d988766-7a9f-4ce3-9d3d-ec0e546577b2 already deleted. [ 1515.334134] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d988766-7a9f-4ce3-9d3d-ec0e546577b2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1515.650594] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1515.650982] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1515.650982] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1515.651264] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1515.651443] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1515.651608] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Segment Port 109bba77-d592-44a2-b03e-6acb641f31c5 not found, creating... [ 1515.651873] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1515.652028] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1515.652147] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1515.652427] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1515.652500] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1515.652775] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1515.653015] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1515.653138] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1515.653344] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1515.653477] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1515.653613] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Resource: SegmentPort with ID: 109bba77-d592-44a2-b03e-6acb641f31c5 is going to be created. [ 1515.674020] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1515.674157] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1515.674285] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1515.674565] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1515.674961] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1515.675145] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "port-109bba77-d592-44a2-b03e-6acb641f31c5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1516.355492] env[65471]: INFO networking_nsxv3.common.synchronization [req-9741ef73-011f-4971-a94c-f1de6b68ff16 req-97fad1c4-1882-4187-86db-59a4dfb16ba9 service nova] Enqueued Resource ID: 6d988766-7a9f-4ce3-9d3d-ec0e546577b2 with Priority: HIGHEST for action security_group_rules [ 1516.355492] env[65471]: INFO networking_nsxv3.common.synchronization [req-9741ef73-011f-4971-a94c-f1de6b68ff16 req-97fad1c4-1882-4187-86db-59a4dfb16ba9 service nova] Enqueued Resource ID: 6d988766-7a9f-4ce3-9d3d-ec0e546577b2 with Priority: HIGHEST for action security_group_members [ 1516.355698] env[65471]: INFO networking_nsxv3.common.synchronization [req-9741ef73-011f-4971-a94c-f1de6b68ff16 req-97fad1c4-1882-4187-86db-59a4dfb16ba9 service nova] Enqueued Resource ID: 109bba77-d592-44a2-b03e-6acb641f31c5 with Priority: HIGHEST for action port [ 1516.356087] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d988766-7a9f-4ce3-9d3d-ec0e546577b2 with Priority: HIGHEST for action security_group_rules [ 1516.356225] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d988766-7a9f-4ce3-9d3d-ec0e546577b2 with Priority: HIGHEST for action security_group_members [ 1516.356345] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 109bba77-d592-44a2-b03e-6acb641f31c5 with Priority: HIGHEST for action port [ 1516.356618] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d988766-7a9f-4ce3-9d3d-ec0e546577b2 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.356741] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d988766-7a9f-4ce3-9d3d-ec0e546577b2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.356803] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d988766-7a9f-4ce3-9d3d-ec0e546577b2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.356992] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d988766-7a9f-4ce3-9d3d-ec0e546577b2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.357083] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d988766-7a9f-4ce3-9d3d-ec0e546577b2',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1516.357909] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d988766-7a9f-4ce3-9d3d-ec0e546577b2 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.358203] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d988766-7a9f-4ce3-9d3d-ec0e546577b2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.358203] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d988766-7a9f-4ce3-9d3d-ec0e546577b2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.358381] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d988766-7a9f-4ce3-9d3d-ec0e546577b2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.358414] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.358516] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.358569] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.358676] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.358759] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1516.358846] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d988766-7a9f-4ce3-9d3d-ec0e546577b2',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1516.359874] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-109bba77-d592-44a2-b03e-6acb641f31c5 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.360051] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-109bba77-d592-44a2-b03e-6acb641f31c5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.360051] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-109bba77-d592-44a2-b03e-6acb641f31c5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.360194] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-109bba77-d592-44a2-b03e-6acb641f31c5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.360268] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('109bba77-d592-44a2-b03e-6acb641f31c5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1516.862191] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d988766-7a9f-4ce3-9d3d-ec0e546577b2',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1516.863286] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d988766-7a9f-4ce3-9d3d-ec0e546577b2 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.863392] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d988766-7a9f-4ce3-9d3d-ec0e546577b2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.863622] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 109bba77-d592-44a2-b03e-6acb641f31c5 with status ACTIVE [ 1516.863860] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.864044] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.864155] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.864439] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.865055] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1516.865055] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.865055] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.865055] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.865055] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.865532] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1516.865532] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.865802] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.865802] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.865943] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.866139] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1516.866240] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 109bba77-d592-44a2-b03e-6acb641f31c5 is going to be updated. [ 1516.886198] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.886414] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.886414] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.886598] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.886729] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1516.886880] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-109bba77-d592-44a2-b03e-6acb641f31c5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.368688] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d988766-7a9f-4ce3-9d3d-ec0e546577b2',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1517.872570] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.872872] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.872872] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.873016] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.873115] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.873221] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d988766-7a9f-4ce3-9d3d-ec0e546577b2 is going to be created. [ 1517.898637] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.898810] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.898858] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.899053] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.899215] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.907661] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d988766-7a9f-4ce3-9d3d-ec0e546577b2 in Status: UNINITIALIZED for 2s [ 1519.918054] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d988766-7a9f-4ce3-9d3d-ec0e546577b2 in Status: SUCCESS [ 1519.918054] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d988766-7a9f-4ce3-9d3d-ec0e546577b2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1519.918054] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d988766-7a9f-4ce3-9d3d-ec0e546577b2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1519.918054] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d988766-7a9f-4ce3-9d3d-ec0e546577b2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1519.918054] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.918637] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.918637] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1519.918637] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1519.918637] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1519.918637] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d988766-7a9f-4ce3-9d3d-ec0e546577b2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1519.918637] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6d988766-7a9f-4ce3-9d3d-ec0e546577b2',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1520.421489] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6d988766-7a9f-4ce3-9d3d-ec0e546577b2',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1520.924265] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6d988766-7a9f-4ce3-9d3d-ec0e546577b2: rpc.has_security_group_logging(os_id): False [ 1520.941600] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.941846] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.941846] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.942035] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.942128] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.942378] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.942479] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.942534] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.942680] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.942752] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.942837] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d988766-7a9f-4ce3-9d3d-ec0e546577b2 is going to be created. [ 1521.003566] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.003876] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.003876] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.004050] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.004194] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.017501] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d988766-7a9f-4ce3-9d3d-ec0e546577b2 in Status: IN_PROGRESS for 2s [ 1521.357496] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1521.357684] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1523.031063] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d988766-7a9f-4ce3-9d3d-ec0e546577b2 in Status: SUCCESS [ 1523.031449] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d988766-7a9f-4ce3-9d3d-ec0e546577b2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1524.805959] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1524.806534] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.806534] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1524.806534] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1524.806731] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1525.310057] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1525.812836] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1526.315067] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1526.315067] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1526.358273] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1526.358482] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1527.090810] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1527.091396] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1527.091396] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1527.091581] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1527.103158] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1527.104020] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1527.105210] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1527.146383] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1527.146598] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1527.146598] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1527.146823] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1527.160950] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1527.161800] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1527.161925] env[65471]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65471) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1527.161991] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1527.192216] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1527.192500] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1527.192500] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1527.192628] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1527.193444] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1527.193614] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1527.271220] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1527.271471] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1527.271471] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1527.271630] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1527.271928] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1527.272206] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1527.345195] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1527.345409] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1527.345409] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1527.345572] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1527.345887] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1527.346194] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:26. [ 1527.346295] env[65471]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'1ba9348d-e766-444a-b0d0-149fd9ba05dd', '34e45751-3d11-4d8a-ad9f-272d1ad803fe', 'ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46', '14a38584-d8ef-4361-b344-b91e376144fa', 'bbd99ac4-1db4-4ccf-af90-c6ef33212f88', 'a976012d-6558-47ff-8d35-cffeac52b05f', '76ee3a37-4552-4528-8f6c-448ca2d9b094', '0c92cf42-7023-4aba-91c3-95f84d379c9f', 'bb4dda56-d5fb-4d9e-a613-8204b35459b5', '918bf7c8-0ca6-4052-a0a9-38a8db5664ea', '7b0e439e-ae4b-45e5-b678-0ea9b193c6d4', 'ba1a1760-87f6-4927-9e91-698752fe3531', '89cca73a-b121-4b09-8f43-f96b481d6295', 'fc59e563-a28d-43a9-a7da-a35d9c5252e5', '2c8ff43e-9a83-418c-851d-179c01ee77a0', 'a70c8576-d6c6-406f-8ebf-d5fb66c56b95', '6d988766-7a9f-4ce3-9d3d-ec0e546577b2', '4d21733d-db9f-4e61-bcaf-373b43488925', '927a7ac0-117d-4551-a979-a43f61af6c25', '1b605f75-31b8-4209-be69-e1c60e682aa5', '50c2c28e-c8d2-4f9e-a431-6df336da2df5', 'b04574ca-6910-4de6-a76c-d7d90c7e2e0c', '1c8a6eda-c0ec-4e25-8652-6acf3d57da4e', '847d876e-b40b-4d73-9c81-1622676c73b5', '85af6c5e-2f9b-491d-9584-96c44b20f99f', '386d020a-c7a5-439c-82eb-884ea70b97b5'} {{(pid=65471) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1527.346398] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1527.365287] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1527.365474] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1527.365474] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1527.365675] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1527.365760] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1527.365869] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1527.365940] env[65471]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65471) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1527.366017] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1527.450205] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1527.450425] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1527.450425] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1527.450627] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1527.451755] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1527.452047] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1527.452138] env[65471]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65471) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1527.452214] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1527.452289] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1527.452402] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/26 resources of Type:Security Group Rules [ 1527.452474] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1ba9348d-e766-444a-b0d0-149fd9ba05dd with Priority: HIGH for action security_group_rules [ 1527.452528] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe with Priority: HIGH for action security_group_rules [ 1527.452584] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46 with Priority: HIGH for action security_group_rules [ 1527.452622] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 14a38584-d8ef-4361-b344-b91e376144fa with Priority: HIGH for action security_group_rules [ 1527.452676] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bbd99ac4-1db4-4ccf-af90-c6ef33212f88 with Priority: HIGH for action security_group_rules [ 1527.452736] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a976012d-6558-47ff-8d35-cffeac52b05f with Priority: HIGH for action security_group_rules [ 1527.452792] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 76ee3a37-4552-4528-8f6c-448ca2d9b094 with Priority: HIGH for action security_group_rules [ 1527.452850] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0c92cf42-7023-4aba-91c3-95f84d379c9f with Priority: HIGH for action security_group_rules [ 1527.452903] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bb4dda56-d5fb-4d9e-a613-8204b35459b5 with Priority: HIGH for action security_group_rules [ 1527.452961] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea with Priority: HIGH for action security_group_rules [ 1527.453031] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 with Priority: HIGH for action security_group_rules [ 1527.453089] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ba1a1760-87f6-4927-9e91-698752fe3531 with Priority: HIGH for action security_group_rules [ 1527.453145] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 89cca73a-b121-4b09-8f43-f96b481d6295 with Priority: HIGH for action security_group_rules [ 1527.453197] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fc59e563-a28d-43a9-a7da-a35d9c5252e5 with Priority: HIGH for action security_group_rules [ 1527.453257] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2c8ff43e-9a83-418c-851d-179c01ee77a0 with Priority: HIGH for action security_group_rules [ 1527.453313] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a70c8576-d6c6-406f-8ebf-d5fb66c56b95 with Priority: HIGH for action security_group_rules [ 1527.453372] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6d988766-7a9f-4ce3-9d3d-ec0e546577b2 with Priority: HIGH for action security_group_rules [ 1527.453424] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4d21733d-db9f-4e61-bcaf-373b43488925 with Priority: HIGH for action security_group_rules [ 1527.453484] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 927a7ac0-117d-4551-a979-a43f61af6c25 with Priority: HIGH for action security_group_rules [ 1527.453541] env[65471]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1b605f75-31b8-4209-be69-e1c60e682aa5 with Priority: HIGH for action security_group_rules [ 1527.453635] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1531.359384] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1531.359854] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1531.359854] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ba9348d-e766-444a-b0d0-149fd9ba05dd with Priority: HIGH for action security_group_rules [ 1531.359854] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46 with Priority: HIGH for action security_group_rules [ 1531.359854] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76ee3a37-4552-4528-8f6c-448ca2d9b094 with Priority: HIGH for action security_group_rules [ 1531.360029] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c8ff43e-9a83-418c-851d-179c01ee77a0 with Priority: HIGH for action security_group_rules [ 1531.360029] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b605f75-31b8-4209-be69-e1c60e682aa5 with Priority: HIGH for action security_group_rules [ 1531.360159] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 927a7ac0-117d-4551-a979-a43f61af6c25 with Priority: HIGH for action security_group_rules [ 1531.360234] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d21733d-db9f-4e61-bcaf-373b43488925 with Priority: HIGH for action security_group_rules [ 1531.360329] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d988766-7a9f-4ce3-9d3d-ec0e546577b2 with Priority: HIGH for action security_group_rules [ 1531.360424] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc59e563-a28d-43a9-a7da-a35d9c5252e5 with Priority: HIGH for action security_group_rules [ 1531.360518] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a70c8576-d6c6-406f-8ebf-d5fb66c56b95 with Priority: HIGH for action security_group_rules [ 1531.360605] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89cca73a-b121-4b09-8f43-f96b481d6295 with Priority: HIGH for action security_group_rules [ 1531.360698] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba1a1760-87f6-4927-9e91-698752fe3531 with Priority: HIGH for action security_group_rules [ 1531.360814] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 with Priority: HIGH for action security_group_rules [ 1531.360925] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea with Priority: HIGH for action security_group_rules [ 1531.361031] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb4dda56-d5fb-4d9e-a613-8204b35459b5 with Priority: HIGH for action security_group_rules [ 1531.361145] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a976012d-6558-47ff-8d35-cffeac52b05f with Priority: HIGH for action security_group_rules [ 1531.361216] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c92cf42-7023-4aba-91c3-95f84d379c9f with Priority: HIGH for action security_group_rules [ 1531.361303] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbd99ac4-1db4-4ccf-af90-c6ef33212f88 with Priority: HIGH for action security_group_rules [ 1531.361391] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe with Priority: HIGH for action security_group_rules [ 1531.361485] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14a38584-d8ef-4361-b344-b91e376144fa with Priority: HIGH for action security_group_rules [ 1531.361819] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ba9348d-e766-444a-b0d0-149fd9ba05dd taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.361949] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ba9348d-e766-444a-b0d0-149fd9ba05dd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.362023] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ba9348d-e766-444a-b0d0-149fd9ba05dd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.362243] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ba9348d-e766-444a-b0d0-149fd9ba05dd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.362327] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ba9348d-e766-444a-b0d0-149fd9ba05dd',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1531.363356] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.363465] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.363536] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.363712] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.363793] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1531.502275] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-76ee3a37-4552-4528-8f6c-448ca2d9b094 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.502275] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-76ee3a37-4552-4528-8f6c-448ca2d9b094" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.502275] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-76ee3a37-4552-4528-8f6c-448ca2d9b094" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.502618] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-76ee3a37-4552-4528-8f6c-448ca2d9b094" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.502618] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('76ee3a37-4552-4528-8f6c-448ca2d9b094',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1531.503774] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c8ff43e-9a83-418c-851d-179c01ee77a0 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.503774] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c8ff43e-9a83-418c-851d-179c01ee77a0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.503774] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c8ff43e-9a83-418c-851d-179c01ee77a0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.504220] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c8ff43e-9a83-418c-851d-179c01ee77a0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.504220] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c8ff43e-9a83-418c-851d-179c01ee77a0',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1531.505018] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1b605f75-31b8-4209-be69-e1c60e682aa5 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.505018] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1b605f75-31b8-4209-be69-e1c60e682aa5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.505018] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1b605f75-31b8-4209-be69-e1c60e682aa5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.505272] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1b605f75-31b8-4209-be69-e1c60e682aa5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.505272] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1b605f75-31b8-4209-be69-e1c60e682aa5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1531.506484] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-927a7ac0-117d-4551-a979-a43f61af6c25 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.506484] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-927a7ac0-117d-4551-a979-a43f61af6c25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.506484] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-927a7ac0-117d-4551-a979-a43f61af6c25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.506484] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-927a7ac0-117d-4551-a979-a43f61af6c25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.506484] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('927a7ac0-117d-4551-a979-a43f61af6c25',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1531.507088] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4d21733d-db9f-4e61-bcaf-373b43488925 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.507225] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4d21733d-db9f-4e61-bcaf-373b43488925" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.507290] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4d21733d-db9f-4e61-bcaf-373b43488925" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.508072] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4d21733d-db9f-4e61-bcaf-373b43488925" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.508072] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4d21733d-db9f-4e61-bcaf-373b43488925',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1531.508244] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d988766-7a9f-4ce3-9d3d-ec0e546577b2 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.508440] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d988766-7a9f-4ce3-9d3d-ec0e546577b2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.508440] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d988766-7a9f-4ce3-9d3d-ec0e546577b2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.508643] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d988766-7a9f-4ce3-9d3d-ec0e546577b2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.508708] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d988766-7a9f-4ce3-9d3d-ec0e546577b2',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1531.509922] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fc59e563-a28d-43a9-a7da-a35d9c5252e5 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.509922] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fc59e563-a28d-43a9-a7da-a35d9c5252e5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.509922] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fc59e563-a28d-43a9-a7da-a35d9c5252e5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.509922] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fc59e563-a28d-43a9-a7da-a35d9c5252e5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.510449] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fc59e563-a28d-43a9-a7da-a35d9c5252e5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1531.510713] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a70c8576-d6c6-406f-8ebf-d5fb66c56b95 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.510847] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a70c8576-d6c6-406f-8ebf-d5fb66c56b95" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.511175] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a70c8576-d6c6-406f-8ebf-d5fb66c56b95" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.511175] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a70c8576-d6c6-406f-8ebf-d5fb66c56b95" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.511374] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a70c8576-d6c6-406f-8ebf-d5fb66c56b95',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1531.511904] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-89cca73a-b121-4b09-8f43-f96b481d6295 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.512112] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-89cca73a-b121-4b09-8f43-f96b481d6295" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.512165] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-89cca73a-b121-4b09-8f43-f96b481d6295" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.512314] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-89cca73a-b121-4b09-8f43-f96b481d6295" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.512391] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('89cca73a-b121-4b09-8f43-f96b481d6295',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1531.513158] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ba1a1760-87f6-4927-9e91-698752fe3531 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.513272] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ba1a1760-87f6-4927-9e91-698752fe3531" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.513582] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ba1a1760-87f6-4927-9e91-698752fe3531" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.513792] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ba1a1760-87f6-4927-9e91-698752fe3531" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.513873] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ba1a1760-87f6-4927-9e91-698752fe3531',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1531.514563] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.514722] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.514722] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.514875] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.514949] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7b0e439e-ae4b-45e5-b678-0ea9b193c6d4',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1531.515650] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-918bf7c8-0ca6-4052-a0a9-38a8db5664ea taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.515785] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.515848] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.515963] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.516066] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('918bf7c8-0ca6-4052-a0a9-38a8db5664ea',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1531.516864] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bb4dda56-d5fb-4d9e-a613-8204b35459b5 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.516982] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bb4dda56-d5fb-4d9e-a613-8204b35459b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.517064] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bb4dda56-d5fb-4d9e-a613-8204b35459b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.517197] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bb4dda56-d5fb-4d9e-a613-8204b35459b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.517290] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bb4dda56-d5fb-4d9e-a613-8204b35459b5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1531.518032] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a976012d-6558-47ff-8d35-cffeac52b05f taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.518145] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a976012d-6558-47ff-8d35-cffeac52b05f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.518191] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a976012d-6558-47ff-8d35-cffeac52b05f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.518343] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a976012d-6558-47ff-8d35-cffeac52b05f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.518416] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a976012d-6558-47ff-8d35-cffeac52b05f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1531.519539] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c92cf42-7023-4aba-91c3-95f84d379c9f taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.519656] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c92cf42-7023-4aba-91c3-95f84d379c9f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.519724] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c92cf42-7023-4aba-91c3-95f84d379c9f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.519926] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c92cf42-7023-4aba-91c3-95f84d379c9f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.520010] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c92cf42-7023-4aba-91c3-95f84d379c9f',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1531.521205] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bbd99ac4-1db4-4ccf-af90-c6ef33212f88 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.521362] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bbd99ac4-1db4-4ccf-af90-c6ef33212f88" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.521463] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bbd99ac4-1db4-4ccf-af90-c6ef33212f88" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.521755] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bbd99ac4-1db4-4ccf-af90-c6ef33212f88" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.521834] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bbd99ac4-1db4-4ccf-af90-c6ef33212f88',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1531.522870] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34e45751-3d11-4d8a-ad9f-272d1ad803fe taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.522988] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.523089] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.523237] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.523309] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34e45751-3d11-4d8a-ad9f-272d1ad803fe',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1531.524175] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14a38584-d8ef-4361-b344-b91e376144fa taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.524175] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14a38584-d8ef-4361-b344-b91e376144fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.524175] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14a38584-d8ef-4361-b344-b91e376144fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.524443] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14a38584-d8ef-4361-b344-b91e376144fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.524443] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14a38584-d8ef-4361-b344-b91e376144fa',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1531.578319] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.578738] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.578738] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.578974] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.580449] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.580582] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.581273] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.581397] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.582074] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.582163] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.582806] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.582912] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.583615] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.583731] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.584418] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.584511] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.601540] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1531.601683] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c8ff43e-9a83-418c-851d-179c01ee77a0 is going to be deleted. [ 1531.602541] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.602748] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.622614] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1531.622784] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ba9348d-e766-444a-b0d0-149fd9ba05dd is going to be deleted. [ 1531.623705] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.623872] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.642063] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1531.642239] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 76ee3a37-4552-4528-8f6c-448ca2d9b094 is going to be deleted. [ 1531.643057] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.643278] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.661238] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.661534] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.665305] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1531.665470] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b605f75-31b8-4209-be69-e1c60e682aa5 is going to be deleted. [ 1531.666310] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.666693] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.682266] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.682471] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.687635] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1531.687816] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4d21733d-db9f-4e61-bcaf-373b43488925 is going to be deleted. [ 1531.688719] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.688928] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.692160] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.692292] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.724878] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.725184] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.731508] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1531.731714] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 89cca73a-b121-4b09-8f43-f96b481d6295 is going to be deleted. [ 1531.732599] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.732849] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.760883] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1531.761072] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46 is going to be deleted. [ 1531.761889] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.762117] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.762209] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1531.762331] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c8ff43e-9a83-418c-851d-179c01ee77a0" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1531.762492] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.762649] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.762726] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1531.762837] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ba9348d-e766-444a-b0d0-149fd9ba05dd" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1531.763392] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.763540] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.763619] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1531.763724] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-76ee3a37-4552-4528-8f6c-448ca2d9b094" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1531.763849] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.763987] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.764077] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1531.764181] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1b605f75-31b8-4209-be69-e1c60e682aa5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1531.785698] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.785919] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.785919] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.786127] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.786218] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1531.786338] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4d21733d-db9f-4e61-bcaf-373b43488925" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1531.858689] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.858952] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.858952] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.859126] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.859238] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1531.859325] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-89cca73a-b121-4b09-8f43-f96b481d6295" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1531.919980] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.920327] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.920327] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.920549] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.920549] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1531.920661] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee8cc4c8-11c6-4a57-a0a9-5b96982fcd46" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.034736] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d988766-7a9f-4ce3-9d3d-ec0e546577b2 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.035025] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d988766-7a9f-4ce3-9d3d-ec0e546577b2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.035025] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d988766-7a9f-4ce3-9d3d-ec0e546577b2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.035123] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d988766-7a9f-4ce3-9d3d-ec0e546577b2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.035254] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.035355] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.035426] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.035574] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.035664] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.035729] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d988766-7a9f-4ce3-9d3d-ec0e546577b2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.035816] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6d988766-7a9f-4ce3-9d3d-ec0e546577b2',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1532.045369] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.045573] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.045573] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.045761] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.071834] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.072218] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.073295] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.073502] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.074140] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.074260] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.074974] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.075095] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.075713] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.075810] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.076441] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.076539] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.080091] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.080273] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.091318] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.091449] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a976012d-6558-47ff-8d35-cffeac52b05f is going to be deleted. [ 1532.092343] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.092567] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.094804] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.094936] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.095888] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.095984] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.096725] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.096807] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.097532] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.097662] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.114152] env[65471]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1532.114761] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.114941] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 927a7ac0-117d-4551-a979-a43f61af6c25 is going to be deleted. [ 1532.115905] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.116128] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.137964] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.138133] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c92cf42-7023-4aba-91c3-95f84d379c9f is going to be deleted. [ 1532.139097] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.139310] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.156407] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.156595] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.160439] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.160621] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 918bf7c8-0ca6-4052-a0a9-38a8db5664ea is going to be deleted. [ 1532.161499] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.161713] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.177340] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.177560] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.181419] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.181555] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34e45751-3d11-4d8a-ad9f-272d1ad803fe is going to be deleted. [ 1532.182415] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.182626] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.207301] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.207472] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ba1a1760-87f6-4927-9e91-698752fe3531 is going to be deleted. [ 1532.208484] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.208717] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.210143] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.210270] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.211350] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.211488] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.235965] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.236215] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bb4dda56-d5fb-4d9e-a613-8204b35459b5 is going to be deleted. [ 1532.237158] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.237376] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.256527] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.256728] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.285934] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.286208] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bbd99ac4-1db4-4ccf-af90-c6ef33212f88 is going to be deleted. [ 1532.287126] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.287358] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.312711] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.312971] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.322107] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.322267] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a70c8576-d6c6-406f-8ebf-d5fb66c56b95 is going to be deleted. [ 1532.323250] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.323489] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.497599] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.498066] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.512258] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.512481] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14a38584-d8ef-4361-b344-b91e376144fa is going to be deleted. [ 1532.513355] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.513582] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.537414] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.537623] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.538507] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.538634] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fc59e563-a28d-43a9-a7da-a35d9c5252e5 is going to be deleted. [ 1532.539514] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.539772] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.540667] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6d988766-7a9f-4ce3-9d3d-ec0e546577b2',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1532.573684] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.573909] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.591576] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.591751] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7b0e439e-ae4b-45e5-b678-0ea9b193c6d4 is going to be deleted. [ 1532.592629] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.592850] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.592941] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.593084] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a976012d-6558-47ff-8d35-cffeac52b05f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.593245] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.593405] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.593483] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.593599] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-927a7ac0-117d-4551-a979-a43f61af6c25" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.594192] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.594346] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.594429] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.594549] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c92cf42-7023-4aba-91c3-95f84d379c9f" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.594679] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.594818] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.594895] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.595010] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-918bf7c8-0ca6-4052-a0a9-38a8db5664ea" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.595144] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.595280] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.595355] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.595464] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34e45751-3d11-4d8a-ad9f-272d1ad803fe" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.595585] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.595721] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.595793] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.595904] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ba1a1760-87f6-4927-9e91-698752fe3531" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.596035] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.596175] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.596249] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.596357] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bb4dda56-d5fb-4d9e-a613-8204b35459b5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.596516] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.596668] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.596745] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.596858] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a70c8576-d6c6-406f-8ebf-d5fb66c56b95" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.596987] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.597142] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.597216] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.597319] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bbd99ac4-1db4-4ccf-af90-c6ef33212f88" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.641960] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.642227] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.642227] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.642396] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.642485] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.642611] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14a38584-d8ef-4361-b344-b91e376144fa" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.686189] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.686406] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.686406] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.686639] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.686734] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.686853] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7b0e439e-ae4b-45e5-b678-0ea9b193c6d4" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.696934] env[65471]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1532.697588] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.697723] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.697791] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.698119] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.698225] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.698347] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fc59e563-a28d-43a9-a7da-a35d9c5252e5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1533.043340] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6d988766-7a9f-4ce3-9d3d-ec0e546577b2: rpc.has_security_group_logging(os_id): False [ 1533.062127] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.062360] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.062360] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.062553] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.082652] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1533.082962] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.083161] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.083161] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.083366] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.083453] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1533.083543] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d988766-7a9f-4ce3-9d3d-ec0e546577b2 is going to be updated. [ 1533.141352] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.141593] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.141593] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.141735] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.141883] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1533.156256] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d988766-7a9f-4ce3-9d3d-ec0e546577b2 in Status: IN_PROGRESS for 2s [ 1535.171867] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d988766-7a9f-4ce3-9d3d-ec0e546577b2 in Status: SUCCESS [ 1535.172332] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d988766-7a9f-4ce3-9d3d-ec0e546577b2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.362941] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1536.363400] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1541.364162] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1541.364539] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1546.365499] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1546.365919] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1551.366893] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1551.367335] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1556.368026] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1556.368411] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1561.369634] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1561.369990] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1566.370388] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1566.370855] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1571.371339] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1571.371743] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1576.372616] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1576.372987] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1581.373674] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1581.374122] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1586.375140] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1586.375140] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1587.733059] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock network-631 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1587.733059] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "network-631" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1587.733059] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "network-631" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1587.733059] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "network-631" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1587.733628] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1587.733628] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1587.733628] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1587.733815] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1587.733951] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1587.734172] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1587.734281] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] NeedRegenerationException {{(pid=65471) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1587.734385] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] no value, waiting for create lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1587.734488] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] value creation lock acquired {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1587.734591] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] No value present for key: 'zone-id' {{(pid=65471) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1587.734690] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Calling creation function for not-yet-present value {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1587.734815] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1587.760933] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1587.761131] env[65471]: DEBUG dogpile.cache.region [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65471) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1587.761252] env[65471]: DEBUG dogpile.lock [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Released creation lock {{(pid=65471) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1587.761422] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "network-631" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1587.761721] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock port-109bba77-d592-44a2-b03e-6acb641f31c5 taken with stack trace [, , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1587.761888] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "port-109bba77-d592-44a2-b03e-6acb641f31c5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1587.762015] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "port-109bba77-d592-44a2-b03e-6acb641f31c5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1587.762290] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "port-109bba77-d592-44a2-b03e-6acb641f31c5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1587.762450] env[65471]: DEBUG networking_nsxv3.api.rpc [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('109bba77-d592-44a2-b03e-6acb641f31c5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1588.264433] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1588.264686] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1588.264790] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1588.265068] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1588.265227] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1588.265512] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1588.265849] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1588.265849] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1588.266023] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1588.266123] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1588.266404] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1588.266604] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1588.266676] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1588.266891] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1588.267012] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1588.267157] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Resource: SegmentPort with ID: 109bba77-d592-44a2-b03e-6acb641f31c5 is going to be updated. [ 1588.288948] env[65471]: DEBUG networking_nsxv3.common.locking [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1588.289211] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1588.289343] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1588.289609] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1588.289799] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1588.290034] env[65471]: DEBUG oslo_concurrency.lockutils [None req-57290187-1fd1-4864-95bf-aa25b98cbc60 None None] Releasing lock "port-109bba77-d592-44a2-b03e-6acb641f31c5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1588.956869] env[65471]: INFO networking_nsxv3.common.synchronization [req-b16f5af9-db18-4b4d-80f7-46b8d483738c req-c49a5185-0f68-480c-bf57-ce6d0bf773b8 service nova] Enqueued Resource ID: 6d988766-7a9f-4ce3-9d3d-ec0e546577b2 with Priority: HIGHEST for action security_group_rules [ 1588.957146] env[65471]: INFO networking_nsxv3.common.synchronization [req-b16f5af9-db18-4b4d-80f7-46b8d483738c req-c49a5185-0f68-480c-bf57-ce6d0bf773b8 service nova] Enqueued Resource ID: 6d988766-7a9f-4ce3-9d3d-ec0e546577b2 with Priority: HIGHEST for action security_group_members [ 1588.957251] env[65471]: INFO networking_nsxv3.common.synchronization [req-b16f5af9-db18-4b4d-80f7-46b8d483738c req-c49a5185-0f68-480c-bf57-ce6d0bf773b8 service nova] Enqueued Resource ID: 109bba77-d592-44a2-b03e-6acb641f31c5 with Priority: HIGHEST for action port [ 1588.957503] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d988766-7a9f-4ce3-9d3d-ec0e546577b2 with Priority: HIGHEST for action security_group_rules [ 1588.957635] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d988766-7a9f-4ce3-9d3d-ec0e546577b2 with Priority: HIGHEST for action security_group_members [ 1588.957732] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 109bba77-d592-44a2-b03e-6acb641f31c5 with Priority: HIGHEST for action port [ 1588.958312] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d988766-7a9f-4ce3-9d3d-ec0e546577b2 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1588.958487] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d988766-7a9f-4ce3-9d3d-ec0e546577b2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1588.958571] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d988766-7a9f-4ce3-9d3d-ec0e546577b2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1588.958769] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d988766-7a9f-4ce3-9d3d-ec0e546577b2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1588.958853] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d988766-7a9f-4ce3-9d3d-ec0e546577b2',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1588.959763] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d988766-7a9f-4ce3-9d3d-ec0e546577b2 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1588.959854] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d988766-7a9f-4ce3-9d3d-ec0e546577b2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1588.959899] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d988766-7a9f-4ce3-9d3d-ec0e546577b2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1588.960103] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d988766-7a9f-4ce3-9d3d-ec0e546577b2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1588.960239] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1588.960330] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1588.960399] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1588.960528] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1588.960607] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1588.960693] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d988766-7a9f-4ce3-9d3d-ec0e546577b2',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1588.961584] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock port-109bba77-d592-44a2-b03e-6acb641f31c5 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1588.961584] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-109bba77-d592-44a2-b03e-6acb641f31c5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1588.961584] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-109bba77-d592-44a2-b03e-6acb641f31c5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1588.961722] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-109bba77-d592-44a2-b03e-6acb641f31c5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1588.961758] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('109bba77-d592-44a2-b03e-6acb641f31c5',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1589.464252] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d988766-7a9f-4ce3-9d3d-ec0e546577b2',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1589.464625] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d988766-7a9f-4ce3-9d3d-ec0e546577b2 taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1589.465392] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d988766-7a9f-4ce3-9d3d-ec0e546577b2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1589.465392] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 109bba77-d592-44a2-b03e-6acb641f31c5 with status ACTIVE [ 1589.465392] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1589.465392] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1589.465392] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1589.465392] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1589.465760] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1589.465760] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1589.465760] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1589.465760] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1589.465924] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1589.465962] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1589.466876] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1589.466876] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1589.466876] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1589.466876] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1589.466876] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1589.466876] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 109bba77-d592-44a2-b03e-6acb641f31c5 is going to be updated. [ 1589.488404] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1589.488588] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1589.488588] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1589.488785] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1589.488916] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1589.489213] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-109bba77-d592-44a2-b03e-6acb641f31c5" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1589.968606] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d988766-7a9f-4ce3-9d3d-ec0e546577b2',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1590.471232] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1590.471514] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1590.471514] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1590.471736] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1590.471821] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1590.471930] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d988766-7a9f-4ce3-9d3d-ec0e546577b2 is going to be updated. [ 1590.502365] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1590.502625] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1590.502625] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1590.502828] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1590.502977] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1590.512427] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d988766-7a9f-4ce3-9d3d-ec0e546577b2 in Status: IN_PROGRESS for 2s [ 1592.525008] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d988766-7a9f-4ce3-9d3d-ec0e546577b2 in Status: SUCCESS [ 1592.525342] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d988766-7a9f-4ce3-9d3d-ec0e546577b2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.525469] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d988766-7a9f-4ce3-9d3d-ec0e546577b2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.525689] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d988766-7a9f-4ce3-9d3d-ec0e546577b2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.525880] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.526014] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.526072] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.526217] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.526298] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.526367] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d988766-7a9f-4ce3-9d3d-ec0e546577b2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.526460] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6d988766-7a9f-4ce3-9d3d-ec0e546577b2',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1593.028575] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6d988766-7a9f-4ce3-9d3d-ec0e546577b2',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1593.530598] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6d988766-7a9f-4ce3-9d3d-ec0e546577b2: rpc.has_security_group_logging(os_id): False [ 1593.548021] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1593.548254] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1593.548254] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1593.548463] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1593.548554] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1593.548812] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1593.548913] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1593.548979] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1593.549239] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1593.549330] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1593.549456] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d988766-7a9f-4ce3-9d3d-ec0e546577b2 is going to be updated. [ 1593.607453] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1593.607713] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1593.607713] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1593.607908] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1593.608098] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1593.633579] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d988766-7a9f-4ce3-9d3d-ec0e546577b2 in Status: IN_PROGRESS for 2s [ 1593.958889] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1593.959087] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1595.650982] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d988766-7a9f-4ce3-9d3d-ec0e546577b2 in Status: SUCCESS [ 1595.651442] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d988766-7a9f-4ce3-9d3d-ec0e546577b2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1598.959708] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1598.960217] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1603.961312] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1603.961675] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1608.962249] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1608.962693] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1613.963715] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1613.964179] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1618.964449] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1618.964449] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1623.965805] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1623.966203] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1628.966709] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1628.966709] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1633.967785] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1633.967785] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1638.968795] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1638.969249] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1639.728379] env[65471]: INFO networking_nsxv3.common.synchronization [req-219ec57b-630a-4121-94df-ff49a817c68a req-6fd89ea9-0bc1-4f76-bfd4-b5fb4bc0fbaf tempest-AttachVolumeShelveTestJSON-1125436198 tempest-AttachVolumeShelveTestJSON-1125436198-project-member] Enqueued Resource ID: 6d988766-7a9f-4ce3-9d3d-ec0e546577b2 with Priority: HIGHEST for action security_group_members [ 1639.728648] env[65471]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d988766-7a9f-4ce3-9d3d-ec0e546577b2 with Priority: HIGHEST for action security_group_members [ 1639.729288] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d988766-7a9f-4ce3-9d3d-ec0e546577b2 taken with stack trace [, , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1639.729288] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d988766-7a9f-4ce3-9d3d-ec0e546577b2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1639.729288] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d988766-7a9f-4ce3-9d3d-ec0e546577b2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1639.729527] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d988766-7a9f-4ce3-9d3d-ec0e546577b2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1639.729570] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1639.730013] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1639.730013] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1639.730013] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1639.730013] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1639.730013] env[65471]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d988766-7a9f-4ce3-9d3d-ec0e546577b2',) {} {{(pid=65471) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1640.232034] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1640.232366] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1640.232366] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1640.232464] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1640.232537] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1640.232746] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1640.232841] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1640.232903] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1640.233064] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1640.233140] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1640.233226] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d988766-7a9f-4ce3-9d3d-ec0e546577b2 is going to be updated. [ 1640.263484] env[65471]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65471) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1640.263706] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1640.263706] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1640.263887] env[65471]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1640.264041] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1640.272148] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d988766-7a9f-4ce3-9d3d-ec0e546577b2 in Status: IN_PROGRESS for 2s [ 1642.283897] env[65471]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d988766-7a9f-4ce3-9d3d-ec0e546577b2 in Status: SUCCESS [ 1642.284467] env[65471]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d988766-7a9f-4ce3-9d3d-ec0e546577b2 deletion is rescheduled due to dependency. [ 1642.284467] env[65471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d988766-7a9f-4ce3-9d3d-ec0e546577b2" {{(pid=65471) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1644.729338] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1644.729826] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1649.729861] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1649.730169] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1654.731368] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1654.731786] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1659.732912] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1659.733338] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1664.734020] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1664.734453] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1669.735795] env[65471]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1669.735795] env[65471]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0